Question

What will be the best score on the GPQA benchmark before 2025?

Resolved :87.787.6

Total Forecasters31

Community Prediction87.6 (87.1 - 88)

Make a Prediction

PDF

CDF

	lower 25%	median	upper 75%
community	87.11	87.59	87.96
My Prediction	—	—	—

Quartiles	community	My Prediction
lower 25%	87.11	—
median	87.59	—
upper 75%	87.96	—

What was the final result?87.7

Community Baseline Score

-24.1

Community Peer Score

41.6

Authors:

romeodean

Opened:

Mar 24, 2024

Closes:

Dec 31, 2024

Resolves:

Jan 1, 2025

AI Benchmarks

Artificial Intelligence

2024 Leaderboard

Machine learning

A test for AGI is closer to being solved — but it may be flawed

TechCrunch•Feb 21, 2025

Did xAI lie about Grok 3’s benchmarks?

TechCrunch•Feb 23, 2025

Radical Data Science

•Feb 25, 2025

Learn more about Metaculus NewsMatch

In the following years, what will be the highest LLM scores on the GPQA Diamond benchmark?

87.5

What will be the best non-human SAT-style score on the hard subset of the QuALITY dataset by January 1, 2030?

What will be the best non-human SAT-style score on the hard subset of the QuALITY dataset by January 1, 2040?

98.2

Comments

? comments