https://andonlabs.com/evals/butter-bench #Robotics #HumanVsRobot #TechHumor #HackerNews #ngated
Butter-Bench: Evaluating LLM Controlled Robots for Practical Intelligence | Andon Labs
Can LLMs control robots? We answer this by testing how good models are at passing the butter โ or more generally, do delivery tasks in a household setting. State of the art models struggle, with the best model scoring 40% at Butter-Bench, compared to 95% for humans.