@codinghorror @temptoetiam
“Saying that any of this is teaching a chatbot philosophy is like calling yourself a psychiatrist because you thought about Oedipus while jacking off. “
🧑🍳💋
Thank you - still reading. But, this:
" Andrej Karpathy recently implemented a fully functional large language model in 200 lines of Python code. He also wrote a detailed explanation of exactly what it does, how it works, and the ways it differs from big company frontier models, which are all just differences of scale and efficiency."
@codinghorror "Does 200 lines of Python code understand anything? My siblings in Christ I hope it’s clear how utterly bizarre this question is."
But, it's Python. https://xkcd.com/413/
@codinghorror The question is not what the 200 lines of code do, they are merely like the handful of neurotransmitters in out biology. The question is what’s going on in the billions of model parameters that seem to encode not only word patterns but also some algorithms for behavior.
The issue of needing to see more training examples than humans need has been addressed by pointing to the work evolution has done in shaping humans that we need to do brute force for LLMs. 2/
@codinghorror And yes, there *are* issues with lack of grounding in the physical world.
I don’t think LLMs are synthetic humans or have emotions, but once we run these things with persistent state and long continuous loops, I expect the results to start to resemble humans a lot more.
@codinghorror ai is people the question is what are they going to do?
#techcrunch.com

Many employees have come and gone since OpenAI first launched a decade ago, and some have launched startups of their own. Among these, some have become top rivals (like Anthropic), while others, just on investor interest alone, have managed to raise billions without even launching a product.