Take Our 🏆Quarterly Cup🏆 Survey

We're considering changes to the Quarterly Cup and want to hear from you, take our short survey to share your thoughts and help shape future iterations of the Cup.

M

Group

What will be state-of-the-art performance on the MATH dataset on the following dates?

20
32
55 forecasters

Make a Prediction

Dateresolution
Date25thmedian75th
community
lower 25%
median
upper 75%
70.71
76.3
79.53

What was the final result?69.6

Community Baseline Score
7.1
Community Peer Score
6.7
Learn more about scores here.

Forecast Timeline

Authors:
jacob.steinhardt
Opened:
Closes:
Scheduled resolution:
AI Technical Benchmarks
Computing and Math
Artificial Intelligence
2021-2025 Leaderboard
2022-2023 Leaderboard
Education
Jacob Steinhardt
Data analysis
OpenAI

Comments

? comments