Tero Keski-ValkamaI'm very optimistic about the next steps of #LargeLanguageModels. Self-competition with #ReinforcementLearning is certainly something many people are working on.
#Google's #Gemini doesn't have many public details yet but is apparently going to use planning engines in #AlphaGo style to achieve the next level of performance in complex tasks. I believe this needs to be trained non-imitatively with reinforcement learning, so it will likely achieve the self-competition gains as well, even ignoring the gains from a possible incorporation of a search/planning engine.
We are now experiencing the quantum leap between human-level systems trained imitatively, and immeasurably above human level systems trained with self-competition in the general language domain.
We'll certainly get an unambiguous #AGI before the end of the year. The beginning is nigh!