Take Our 🏆Quarterly Cup🏆 Survey

We're considering changes to the Quarterly Cup and want to hear from you, take our short survey to share your thoughts and help shape future iterations of the Cup.

M

Group

What will be state-of-the-art accuracy on the Massive Multitask dataset on the following dates?

12
38
45 forecasters

Make a Prediction

Dateresolution
Date25thmedian75th
community
lower 25%
median
upper 75%
85.59
86.61
87.92

What was the final result?86.4

Community Baseline Score
49.4
Community Peer Score
26.3
Learn more about scores here.

Forecast Timeline

Authors:
jacob.steinhardt
Opened:
Closes:
Scheduled resolution:
AI Technical Benchmarks
Artificial Intelligence
2021-2025 Leaderboard
2022-2023 Leaderboard
Machine learning
Linguistics
Data analysis
OpenAI

Comments

? comments