One of the decisive moments in my understanding of #LLMs and their limitations was when, last autumn, @emilymbender walked me through her Thai Library thought experiment.

She's now written it up as a Medium post, and you can read it here. The value comes from really pondering the question she poses, so take the time to think about it. What would YOU do in the situation she outlines?

https://medium.com/@emilymenonbender/thought-experiment-in-the-national-library-of-thailand-f2bf761a8a83

@ct_bergstrom @emilymbender The Thai library task is maybe impossible for a single human (the task of reading everything is already impossible during a typical lifespan), but it is probably possible for a machine. For some results on supervised machine translation see https://linguistics.stackexchange.com/a/34102/9781
Could the Ancient Egyptian hieroglyphs have been deciphered without the Rosetta Stone with modern tech?

The Rosetta Stone was one of the most important documents in the history of linguistics. Discovered around 1800, it allowed Ancient Egyptian to be deciphered. Let's say that the stone didn't exist,...

Linguistics Stack Exchange
@jk @ct_bergstrom @emilymbender isn't the Thai Library an example of unsupervised learning?