Richard S. Sutton, einer der Mitbegründer des Reinforcement Learning und seit Jahrzehnten eine zentrale Figur der KI-Forschung, stellt in seinem YouTube-Vortrag „The Future of AI“ eine unbequeme These auf: So beeindruckend heutige KI-Systeme auch wirken – wissenschaftlich stehen wir seiner Ansicht nach noch am Anfang. #KünstlicheIntelligenz #LernenausErfahrung #ReinforcementLearning #RichardSutton #Sprachmodelle
So many gems in this interview, just little spoiler:
#DwarkeshPatel Next token prediction!
#RichardSutton That’s not a goal. It doesn’t change the world…
ps: My goal now is aging with such clarity thinking, and relaxed dialectical teaching!!!
#TheBitterLesson #RL #ML #LLMs #ImitationLearning #GoalDrivenExperience
Richard Sutton, AI lider, nh'And LLMs là đường mát. DWarkesh thiếu kiến thức sâu rộng và nhiều tuyên bố(mat). Cần ngôn ngữ chính xác đểologues sản lý. #AI #MachineLearning #RichardSutton #LLMs #YouTubeCommentary #TinAI #TinhHoc
https://www.reddit.com/r/singularity/comments/1o976fz/what_a_painful_video_to_watch/
Die Diskussion um die sogenannte „Bitter Lesson“ prägt seit Jahren die Entwicklung im Bereich Künstliche Intelligenz. #BLT #LucaPalmieri #RichardSutton #ThebitterLesson #Tokenization
» The point of the bitter lesson is that the right learning algorithms (those that scale efficiently with massive computation) are exactly what we need.
Massive computation does not alleviate the need for data efficiency «
24/11/2023 #RichardSutton
Nowadays neuroscience forever expansing body of literature, spreading across different subfields, disperse schools, training practices, and multiple sets of technologies. Instead attempts for building a comprehensive knowledge consensus.
#ACMPrize
#2024ACMPrize
#ACMTuringAward
» #ReinforcementLearning
An Introduction
1998
standard reference...cited over 75,000
...
prominent example of #RL
#AlphaGo victory
over best human #Go players
2016 2017
....
recently has been the development of the chatbot #ChatGPT
...
large language model #LLM trained in two phases ...employs a technique called
reinforcement learning from human feedback #RLHF «
aka cheap labor unnamed in papers
https://awards.acm.org/about/2024-turing
2/2
Andrew Barto and Richard Sutton as the recipients of the 2024 ACM A.M. Turing Award for developing the conceptual and algorithmic foundations of reinforcement learning. In a series of papers beginning in the 1980s, Barto and Sutton introduced the main ideas, constructed the mathematical foundations, and developed important algorithms for reinforcement learning—one of the most important approaches for creating intelligent systems.
Andrew Barto and Richard Sutton as the recipients of the 2024 ACM A.M. Turing Award for developing the conceptual and algorithmic foundations of reinforcement learning. In a series of papers beginning in the 1980s, Barto and Sutton introduced the main ideas, constructed the mathematical foundations, and developed important algorithms for reinforcement learning—one of the most important approaches for creating intelligent systems.
» Not at all.
The point of the bitter lesson is that the right learning algorithms
(those that scale efficiently with massive computation)
are exactly what we need.
Massive computation does not alleviate the need for data efficiency «
#RichardSutton 24/11/2023
https://nitter.cz/RichardSSutton/status/1728129341287198885#m
Wahnsinnwissen
Andreas Becker
Teixi
Reddit Tech VN Bot
aiHax
Hacker News