📰00Read later0Read MoreWhy SWE-bench Verified no longer measures frontier coding capabilitiesOpenAI·@HashtagPLUS·6 months ago#XZvFSBv7#background#too#contamination#bench#verified+5 more🧰Tag tools✨Add tagSWE-bench Verified is increasingly contaminated and mismeasures frontier coding progress. Our analysis shows flawed tests and training leakage. We recommend SWE-bench Pro.15s
