2/2 That's why when a calf is born, it can stand immediately while a human takes months to learn to stand. Thinking about intelligence without this time factor during which reinforcement learning happened over hundreds of thousands of years to learn all of the evolution is a incomplete thinking about intelligence.

#RL #AI #ArtificialIntelligence #BitterLesson #DwarkeshPatel #LLM

The Bitter Lesson of LLM Extensions

From ChatGPT Plugins to Agent Skills, a look at how we've been trying (and failing) to extend LLMs for the last three years.

The Bitter Lesson is coming for Tokenization

Highlights the desire to replace tokenization with a general method that better leverages compute and data. We'll see tokenization's fragility and review the Byte Latent Transformer arch.

⛰️ lucalp

Forget Understanding, Scale! - Murray Shanahan on Johnathan Bi

#understanding #bitterlesson #scaling