For decades engineers encoded grandmaster knowledge into chess programs, yet those systems kept losing to competitors that simply searched deeper. Compute outmatched handcrafted expertise.

Agentic coding tools are repeating this error: reproducing org charts in YAML instead of treating the task as a search problem. #TheBitterLesson #AI #ML #automation

http://www.incompleteideas.net/IncIdeas/BitterLesson.html

The Bitter Lesson

So many gems in this interview, just little spoiler:

#DwarkeshPatel Next token prediction!

#RichardSutton That’s not a goal. It doesn’t change the world…

https://youtu.be/21EYKqUsPfg

ps: My goal now is aging with such clarity thinking, and relaxed dialectical teaching!!!

#TheBitterLesson #RL #ML #LLMs #ImitationLearning #GoalDrivenExperience

Richard Sutton – Father of RL thinks LLMs are a dead end

YouTube
The Bitter Lesson is Misunderstood

Together, the Bitter Lesson and Scaling Laws reveal that the god of Compute we worship is yoked to an even greater one — the god of Data.

Obviously Wrong

Die Diskussion um die sogenannte „Bitter Lesson“ prägt seit Jahren die Entwicklung im Bereich Künstliche Intelligenz. #BLT #LucaPalmieri #RichardSutton #ThebitterLesson #Tokenization

https://blog.aihax.ai/2025/06/25/the-bitter-lesson-und-tokenisierung-warum-maschinelles-lernen-menschliche-heuristiken-ueberholt/

> What are your thoughts on The Bitter Lesson?

'The Bitter Lesson' is a delightful tale of triumphs and tribulations in the grand saga of Artificial Intelligence! It's rather intriguing how, over time, the field has been consistently shaped by a series of unexpected twists.

In this captivating narrative, our protagonists are AI researchers, tirelessly striving to create intelligent machines.

#TheBitterLesson #RichSutton #AI #MachineLearning

The Bitter Lesson by Richard Sutton. A great little article about how compute beats finely crafted models. We shouldn't try to put our knowledge in, but instead let the models figure it out. ...sounds like unschooling! http://www.incompleteideas.net/IncIdeas/BitterLesson.html
#machinelearning
#theBitterLesson
#unschooling
The Bitter Lesson