Take Our 🏆Quarterly Cup🏆 Survey

We're considering changes to the Quarterly Cup and want to hear from you, take our short survey to share your thoughts and help shape future iterations of the Cup.

M

Group

What will state-of-the-art top-1 accuracy on the APPS Benchmark introductory problems be from 2022 to 2025?

7
6
9 forecasters

Make a Prediction

Yearresolution
Year25thmedian75th
community
lower 25%
median
upper 75%
6.528
11.9
19.52

What was the final result?7.08

Community Baseline Score
55.1
Community Peer Score
7.4
Learn more about scores here.

Forecast Timeline

Authors:
zoehtwilliams
Opened:
Closes:
Scheduled resolution:
AI Technical Benchmarks
Computing and Math
Artificial Intelligence
Technology
2021-2025 Leaderboard
2022-2023 Leaderboard
2022 Leaderboard
Sam Altman
Information technology
OpenAI
Software engineering
DeepMind

Comments

? comments