Question

What will be the best score on the GAIA benchmark before 2025?

Resolved :65.165

Total Forecasters19

Community Prediction65 (64.2 - 65.7)

Make a Prediction

PDF

CDF

	lower 25%	median	upper 75%
community	64.21	65.05	65.72
My Prediction	—	—	—

Quartiles	community	My Prediction
lower 25%	64.21	—
median	65.05	—
upper 75%	65.72	—

What was the final result?65.1

Community Baseline Score

-15.0

Community Peer Score

14.6

Authors:

romeodean

Opened:

Mar 24, 2024

Closes:

Dec 31, 2024

Resolves:

Jan 1, 2025

AI Technical Benchmarks

AI Benchmarks

Artificial Intelligence

The hottest AI models, what they do, and how to use them

TechCrunch•Feb 18, 2025

How Elon Musk's Grok 3 Compares to ChatGPT, DeepSeek

Newsweek•Feb 19, 2025

The shine began to wear off AI in 2024 as advances slowed down

New Scientist•Feb 19, 2025

Learn more about Metaculus NewsMatch

In the following years, what will be the highest LLM scores on the GPQA Diamond benchmark?

87.5

What will be the best non-human SAT-style score on the hard subset of the QuALITY dataset by January 1, 2030?

What will be the best non-human SAT-style score on the hard subset of the QuALITY dataset by January 1, 2040?

98.2

Comments

? comments