Hacker NewsHuman-Like Neural Nets by Catapulting
https://gwern.net/llm-catapult
#HackerNews #HumanLikeNeuralNets #Catapulting #AI #MachineLearning #Innovation
Human-like Neural Nets by Catapulting
Speculative proposal to create artificial neural nets with human-like performance by high-learning-rate/regularization training of overparameterized NNs to trigger catapulting/grokking. Over-parameterization as a route to true generalization would resolve many outstanding mysteries of artificial versus natural intelligence.
Osna.FM