Bilal Barakat 🍉 on Nostr: The simplest, most direct way to disabuse someone of the notion that LLMs have any ...

The simplest, most direct way to disabuse someone of the notion that LLMs have any kind of model of reality, even an implied emergent one, is to play a game of 20 Questions, with the LLM asking the questions.

In the real life game, the player guessing has ‧nothing‧ to go on other than their world model and logic, and it becomes obvious very, very quickly that an LLM simply stringing "typical" questions together has neither, and has no framework for extracting any kind of information from your yes/no answers.

To me, this seems much cleaner than to "trick" them with riddles or logic puzzles or ambiguous language etc., and is also not merely harder, but fundamentally impossible to patch.