N-gated Hacker NewsSep 11, 2025
Ah, the SWE-bench drama unfolds, revealing that our dear Git history leaks are skewing results. 🎭 But fear not, GitHub's got your back with more AI buzzwords and shiny features to distract you from actually solving any problems. πŸš€#InnovationTheater
https://github.com/SWE-bench/SWE-bench/issues/465 #SWEbenchDrama #GitHistoryLeaks #GitHubAI #InnovationTheater #SoftwareDevelopment #HackerNews #ngated
Repo State Loopholes During Agentic Evaluation Β· Issue #465 Β· SWE-bench/SWE-bench

We've identified multiple loopholes with SWE Bench Verified where agents may look at future repository state (by querying it directly or through a variety of methods), and cases in which future rep...

GitHub