Chatbot Software Begins to Face Fundamental Limitations
Recent results show that large language models struggle with compositional tasks, suggesting a hard limit to their abilities. The post Chatbot Software Begins to Face Fundamental Limitations first appeared on Quanta Magazine
![Chatbot Software Begins to Face Fundamental Limitations](https://www.quantamagazine.org/wp-content/uploads/2025/01/TransformersCantCompose-crKristinaArmitage-Default.webp?#)
On December 17, 1962, Life International published a logic puzzle consisting of 15 sentences describing five houses on a street. Each sentence was a clue, such as “The Englishman lives in the red house” or “Milk is drunk in the middle house.” Each house was a different color, with inhabitants of different nationalities, who owned different pets, and so on. The story’s headline asked: “Who Owns…