Question
What MMLU benchmark score will Google DeepMind's Gemini model have on release?
Resolved :71.874.4Total Forecasters19
Community Prediction74.4 (71.9 - 84.2)
Make a Prediction
CDF
Quartiles | community | My Prediction |
lower 25% | 71.85 | — |
median | 74.45 | — |
upper 75% | 84.21 | — |
What was the final result?71.8
Community Baseline Score
-18.2
Community Peer Score
0.8
Authors:
Opened:Oct 27, 2023
Closes:Dec 31, 2024
Resolves:Dec 31, 2024
Comments
? comments
Authors:
Opened:Oct 27, 2023
Closes:Dec 31, 2024
Resolves:Dec 31, 2024