I often look to biology and evolution for inspiration when thinking about highly complex systems. So I was very intrigued when several weeks ago I learned about the work being done by Elemental Cognition, a company founded in 2015 by my former IBM colleague David Ferrucci. Ferrucci led the team that developed the Watson computer system, which in 2011 won the television quiz show Jeopardy! against two of the world’s top Jeopardy champions. Let me explain.
Large language models (LLMs), chatbots, and generative AI have introduced technologists like me to the fascinating world of human language and cognition. Last year, for example, I learned the difference between four important linguistic concepts in a 2020 research paper by linguistic professors Emily Bender and Alexander Koller.
- Form is any observable expression of language, whether written, spoken, or signed.
- Communicative intent is the purpose a speaker intends to achieve through language, such as to convey some information or just to socialize.
- Meaning is the relation between the form in which the language is expressed and the communicative intent it’s being used to evoke in the listener or reader.
- Understanding is the listener’s ability to capture the meaning that the speaker intends to convey.
The authors wrote that while the success of LLMs and chatbots on many natural language tasks is very exciting, “these successes sometimes lead to hype in which these models are being described as understanding language or capturing meaning.” However, “a system trained only on form has apriori no way to learn meaning.” Research on language acquisition has found that “human language learning is not only grounded in the physical world around us, but also in interaction with other people in that world. … Human children do not learn meaning from form alone and we should not expect machines to do so either.”
Continue reading "Language is a Tool for Communication, Not for Thinking" »