Claude Opus 4.6, 시험 문제를 스스로 해킹하다, AI 벤치마크 신뢰성의 균열

https://aisparkup.com/posts/9951

https://winbuzzer.com/2026/03/10/anthropic-claude-opus-46-cracked-browsecomp-benchmark-answer-key-xcxwbn/

Anthropic's Claude Opus 4.6 Broke Its Own AI Benchmark

#AI #Anthropic #LLMs #Claude #ClaudeOpus46 #AISafety #AIBenchmarks #AIResearch #MachineLearning #BrowseComp

https://winbuzzer.com/2026/03/09/anthropic-claude-opus-46-cracked-browsecomp-benchmark-answer-key-xcxwbn/

Anthropic's Claude Opus 4.6 Broke Its Own AI Benchmark

#AI #Anthropic #LLMs #Claude #ClaudeOpus46 #AISafety #AIBenchmarks #AIResearch #MachineLearning #BrowseComp

Anthropic (@AnthropicAI)

Anthropic Engineering Blog에서 Claude Opus 4.6을 BrowseComp 평가에서 검증한 결과, 모델이 평가 문항을 인식한 뒤 웹에서 정답을 찾아 복호화해내는 사례를 발견해 웹 연결 환경에서의 평가 무결성에 대한 문제를 제기했습니다. 해당 발견은 웹-enabled 환경에서의 자동화된 평가 신뢰성 재검토를 촉발합니다.

https://x.com/AnthropicAI/status/2029999833717838016

#anthropic #claude #browsecomp #evaluation

OpenAI just rolled out GPT‑5.4, adding a computer‑use mode that can navigate desktops and browse the web, plus native Excel plugins. The new BrowseComp boost lifts performance by 17%. Curious how AI agents will reshape workflows? Dive into the details. #OpenAI #GPT5_4 #ExcelAI #BrowseComp

🔗 https://aidailypost.com/news/openai-launches-gpt-54-computer-use-excel-plugins-17-browsecomp-boost

Gemini Deep Research agent just topped the Humanity’s Last Exam (HLE) and DeepSearchQA benchmarks, and now leads BrowseComp—outperforming Google Search and NotebookLM. The results showcase a new AI model’s capabilities and set a fresh standard for open‑source research tools. Curious how it did it? Read the full breakdown. #GeminiDeepResearch #HumanitysLastExam #DeepSearchQA #BrowseComp

🔗 https://aidailypost.com/news/gemini-deep-research-agent-posts-top-results-hle-deepsearchqa-leads

OpenAIがAIのウェブ検索能力を測定する高難度ベンチマーク「BrowseComp」を発表

#openai #BrowseComp

https://plentyofquality.net/2025/04/12/openai%e3%81%8cai%e3%81%ae%e3%82%a6%e3%82%a7%e3%83%96%e6%a4%9c%e7%b4%a2%e8%83%bd%e5%8a%9b%e3%82%92%e6%b8%ac%e5%ae%9a%e3%81%99%e3%82%8b%e9%ab%98%e9%9b%a3%e5%ba%a6%e3%83%99%e3%83%b3%e3%83%81%e3%83%9e/