M

Question

What MMLU benchmark score will Google DeepMind's Gemini model have on release?

Resolved :71.874.4
Total Forecasters19
Community Prediction74.4 (71.9 - 84.2)

Make a Prediction

PDF

CDF

QuartilescommunityMy Prediction
lower 25%71.85
median74.45
upper 75%84.21

What was the final result?71.8

Community Baseline Score
-18.2
Community Peer Score
0.8
Authors:
Opened:Oct 27, 2023
Closes:Dec 31, 2024
Resolves:Dec 31, 2024

Comments

? comments