@jwz
One of the best things about these language models is how well they hold onto technical details, even if they are pretty heavy and complex to run.

I think this is the only real use for these language models.