M

Question

What MMLU benchmark score will Google DeepMind's Gemini model have on release?

Resolved :71.874.4
Total Forecasters19
Community Prediction74.4 (71.9 - 84.2)

Make a Prediction

PDF

CDF

My Prediction
community
lower 25%
median
upper 75%
...
...
...
71.85
74.45
84.21

What was the final result?71.8

Community Baseline Score
-18.2
Community Peer Score
0.8
Authors:
Opened:Oct 27, 2023
Closes:Dec 31, 2024
Resolves:Dec 31, 2024

Comments

? comments