Group

What will be state-of-the-art accuracy on the Massive Multitask dataset on the following dates?

38 comments38

45 forecasters

Make a Prediction

Date

resolution

Date

median

PDF

Forecast Timeline

June 30, 2025

June 30, 2024

June 30, 2023

Authors:

jacob.steinhardt

Opened:

Jul 4, 2022

Closes:

Jun 29, 2025

Scheduled resolution:

Jun 30, 2025

AI Technical Benchmarks

Artificial Intelligence

2021-2025 Leaderboard

2022-2023 Leaderboard

MLB win totals 2025: Projecting every team's record for the new season

USA Today•Feb 12, 2025

These researchers used NPR Sunday Puzzle questions to benchmark AI ‘reasoning’ models

TechCrunch•Feb 17, 2025

These are the hottest AI models, what they do, and how to use them

TechCrunch•Feb 17, 2025

Learn more about Metaculus NewsMatch

What will be state-of-the-art performance on the MATH dataset on the following dates?

91.1

When will AI achieve competency on multi-choice questions across diverse fields of expertise (MMLU)?

2025-08-06

What will the be the state-of-the-art performance on image classification on ImageNet in top-1 accuracy on the following dates?

91.9

Comments

? comments

Authors:

jacob.steinhardt

Opened:

Jul 4, 2022

Closes:

Jun 29, 2025

Scheduled resolution:

Jun 30, 2025

AI Technical Benchmarks

Artificial Intelligence

2021-2025 Leaderboard

2022-2023 Leaderboard

MLB win totals 2025: Projecting every team's record for the new season

USA Today•Feb 12, 2025

These researchers used NPR Sunday Puzzle questions to benchmark AI ‘reasoning’ models

TechCrunch•Feb 17, 2025

These are the hottest AI models, what they do, and how to use them

TechCrunch•Feb 17, 2025

Learn more about Metaculus NewsMatch

What will be state-of-the-art performance on the MATH dataset on the following dates?

91.1

When will AI achieve competency on multi-choice questions across diverse fields of expertise (MMLU)?

2025-08-06

What will the be the state-of-the-art performance on image classification on ImageNet in top-1 accuracy on the following dates?

91.9