Ilya Sutskever: Scaling Laws sind am Ende:

- Modelle leiden an Jaggedness, lösen Komplexes aber scheitern an simpler Logik
- Pre-Training riesiger Datenmengen wird durch gezieltes Reasoning ersetzt
- Emotionen sollen zur Daten-Priorisierung simuliert werden

Hält SSI die Lösung wirklich wegen Safety zurück oder ist der Ansatz noch nicht marktreif? #Sutskever #AI #SSI
https://www.all-ai.de/news/news24/sutskevers-superintelligenz

Sutskever and LeCun: Scaling LLMs Won't Yield More Useful Results

https://www.abzglobal.net/web-development-blog/ilya-sutskever-yann-lecun-and-the-end-of-just-add-gpus

#HackerNews #Sutskever #LeCun #LLMs #AIresearch #MachineLearning

Ilya Sutskever giải thích tại sao tác động kinh tế của AI lại chậm hơn so với thành tích benchmark! Trong 10 phút đầu, ông đưa ra những góc nhìn sâu sắc về tương lai công nghệ.
#AI #Sutskever #ArtificialIntelligence #CôngNgànhAI #PhátTriểnKỹThuật

https://www.reddit.com/r/singularity/comments/1p6jmjp/ilya_sutskever_age_of_research/

“We’ve achieved peak data and there’ll be no more.”

OpenAI’s cofounder and former chief scientist,
#Ilya #Sutskever, made headlines earlier this year after he left to start his own AI lab called
Safe Superintelligence Inc.

He has avoided the limelight since his departure but made a rare public appearance in Vancouver on Friday at the
Conference on Neural Information Processing Systems (NeurIPS).

“Pre-training as we know it will unquestionably end,” Sutskever said onstage.

This refers to the first phase of AI model development,
when a large language model learns patterns from vast amounts of unlabeled data
— typically text from the internet, books, and other sources.

During his NeurIPS talk, Sutskever said that,
while he believes existing data can still take AI development farther,
the industry is tapping out on new data to train on.

This dynamic will, he said, eventually force a shift away from the way models are trained today.

He compared the situation to fossil fuels:
just as oil is a finite resource,
the internet contains a finite amount of human-generated content.

“We’ve achieved peak data and there’ll be no more,” according to Sutskever.

“We have to deal with the data that we have. There’s only one internet

Next-generation models, he predicted, are going to “be agentic in a real ways.”

Agents have become a real buzzword in the AI field.

While Sutskever didn’t define them during his talk, they are commonly understood to be an autonomous AI system that performs tasks, makes decisions,
and interacts with software on its own.

Along with being “agentic,” he said future systems will also be able to reason.

Unlike today’s AI, which mostly pattern-matches based on what a model has seen before,
future AI systems will be able to work things out step-by-step in a way that is more comparable to thinking.

The more a system reasons, “the more unpredictable it becomes,” according to Sutskever.

He compared the unpredictability of “truly reasoning systems” to how advanced AIs that play chess “are unpredictable to the best human chess players.”

“They will understand things from limited data,” he said.

“They will not get confused.”

On stage, he drew a comparison between the scaling of AI systems and evolutionary biology,
citing research that shows the relationship between brain and body mass across species.

He noted that while most mammals follow one scaling pattern, hominids (human ancestors) show a distinctly different slope in their brain-to-body mass ratio on logarithmic scales.

He suggested that, just as evolution found a new scaling pattern for hominid brains,
AI might similarly discover new approaches to scaling beyond how pre-training works today.
https://www.theverge.com/2024/12/13/24320811/what-ilya-sutskever-sees-openai-model-data-training

5 miliardi di dollari per una #startup di 3 mesi: il record di #SafeSuperIntelligence ⤵️⤵️
https://innovationisland.it/safe-superintelligence-5-miliardi-dollari-startup/

#Sutskever #OpenAI #intelligenzaartificiale #AI #IA

Oltre #OpenAI, #Sutskever lancia la sfida per creare un'#IA che superi l'uomo... in sicurezza ⤵️⤵️

https://innovationisland.it/openai-sutskever-intelligenza-artificiale/

Ilya Sutskever forms new AI startup to pursue 'safe superintelligence'

Former OpenAI chief scientist promises efforts will be insulated from commercial pressures

https://www.computing.co.uk/news/4325343/ilya-sutskever-forms-ai-startup-pursue-safe-superintelligence

#ai #ssi #ilyasutskever #sutskever #openai #superintelligence #technews

💡Ilya Sutskever, co-fondatore di OpenAI, fonda Safe Superintelligence Inc. ( @ssi )

https://gomoot.com/ilya-sutskever-co-fondatore-di-openai-fonda-safe-superintelligence-inc-ssi

#AI #blog #ia #news #OpenAI #ssi #Sutskever #tech #tecnologia @ilyasut