Take Our ๐Ÿ†Quarterly Cup๐Ÿ† Survey

We're considering changes to the Quarterly Cup and want to hear from you, take our short survey to share your thoughts and help shape future iterations of the Cup.

M

Question

On January 1, 2025, which frontier AI lab will have a publicly available model with the highest score on the MMLU benchmark?

9
12
41 forecasters

Forecast Timeline

Total Forecasters 41

Make a Prediction

LabMe
OpenAI
49.9%
Anthropic
29%
Google DeepMind
16.7%
Meta
1.8%
Mistral
0.5%
Other
2.1%
Total: ?
(? remaining)
Learn more about scores here.
Authors:
Opened:
Closes:
Scheduled resolution:

Comments

? comments