Nassim Nicholas TalebApr 1, 2023

That ChatGPT passes exams is much more a reflection on exams than information about ChatGPT.

#WittgensteinsRuler

Show threadAdam Johnson  
@nntaleb it only memorizes the answers anyway https://aisnakeoil.substack.com/p/gpt-4-and-professional-benchmarks
GPT-4 and professional benchmarks: the wrong answer to the wrong question

OpenAI may have tested on the training data. Besides, human benchmarks are meaningless for bots.

AI Snake Oil
Apr 1, 2023 at 2:21pmWeb
Show threadAlex  🔧🔮🌎🪿Apr 2, 2023
@adamchainz
"Try this one weird trick to pass every exam"
@nntaleb