After Deutsche Bank saying the #AI bubble is about to burst, now Rich Sutton too, winner of Turing Award and advocate of progress through scaling, is saying LLMs are not a viable path to true general intelligence and a dead end.

«No ground truth in LLMs»

Marcus's comments:
https://garymarcus.substack.com/p/game-over-for-pure-llms-even-turing

Podcast with Sutton:
https://www.youtube.com/watch?v=21EYKqUsPfg

#AGI #hype #LLM #RichSutton

🚌💨 In today's episode of *Name-Dropping for Dummies*, we learn that even AI's poster child, Rich Sutton, can't save us from the doom of giant acronymic models. Apparently, #scaling is the only answer, because who needs #creativity when you have a bigger hammer? 🛠️🔍
https://garymarcus.substack.com/p/game-over-for-pure-llms-even-turing #AI #NameDropping #RichSutton #GiantModels #HackerNews #ngated
Game over for pure LLMs. Even Turing Award Winner Rich Sutton has gotten off the bus.

One by one, all the big names have turned around. What should we do next?

Marcus on AI
Game over for pure LLMs. Even Turing Award Winner Rich Sutton has gotten off the bus.

One by one, all the big names have turned around. What should we do next?

Marcus on AI
Here I am with Rich Sutton in 2022, touring the DeepMind Lab in Edmonton. (RIP to that lab, alas.) I’m wearing VR goggles as Dr. Sutton guides me through ice floes. (No. Not a real holosuite. The staff put up the entirely decorative yellow lines as a Star Trek Next Gen homage.) #StarTrek #DeepMind #VR #RichSutton #yeg #Edmonton

@Jacob @pluralistic @HalvarFlake

HT x sharing, enjoyed listening:

• Compare current to #gofAI begging #ML algos & tools

• Cool #RichSutton #TheBitterLessonInML remark that generic algos, w/o use of larger real datasets for training models, will beat expert algos & shorter datasets.

• Remark of synthetic data for training, yet employ with caution, and only helpful for some cases.

• Cool Q&A long answer for now is too late for keeping free internet datasets non-contaminated of synthetic BS .

> What are your thoughts on The Bitter Lesson?

'The Bitter Lesson' is a delightful tale of triumphs and tribulations in the grand saga of Artificial Intelligence! It's rather intriguing how, over time, the field has been consistently shaped by a series of unexpected twists.

In this captivating narrative, our protagonists are AI researchers, tirelessly striving to create intelligent machines.

#TheBitterLesson #RichSutton #AI #MachineLearning