M

Question

What will be the best score on the SWE-Bench (unassisted) benchmark before 2025?

Resolved :29.430.9
Total Forecasters25
Community Prediction30.9 (29.4 - 34.8)

Make a Prediction

PDF

CDF

QuartilescommunityMy Prediction
lower 25%29.44
median30.87
upper 75%34.77

What was the final result?29.4

Community Baseline Score
59.1
Community Peer Score
19.6
Authors:
Opened:Mar 24, 2024
Closes:Dec 31, 2024
Resolves:Jan 1, 2025

Comments

? comments