M

Group

What will state-of-the-art top-1 accuracy on the APPS Benchmark introductory problems be from 2022 to 2025?

7
6
9 forecasters

Make a Prediction

Yearresolution
Year25thmedian75th
community
lower 25%
median
upper 75%
32.9
42.5
54.6

What was the final result?54.5

Community Baseline Score
-1.0
Community Peer Score
19.0
Learn more about scores here.

Forecast Timeline

Total Forecasters 7
Authors:
zoehtwilliams
Opened:
Closes:
Scheduled resolution:
AI Technical Benchmarks
Computing and Math
Artificial Intelligence
Technology
2021-2025 Leaderboard
2022-2023 Leaderboard
2022 Leaderboard
Sam Altman
Information technology
OpenAI
Software engineering
DeepMind

Comments

? comments