Group

What will be state-of-the-art performance on the MATH dataset on the following dates?

55 forecasters

Make a Prediction

Date	resolution
June 30, 2023	69.6
June 30, 2024	-
Date	25th	median	75th
June 30, 2025	93.8 ...	96.7 ...	98.8 ...

community

lower 25%

median

upper 75%

70.71

76.3

79.53

What was the final result?69.6

Community Baseline Score

7.1

Community Peer Score

6.7

Forecast Timeline

June 30, 2025

June 30, 2024

June 30, 2023

Authors:

jacob.steinhardt

Opened:

Closes:

Scheduled resolution:

AI Technical Benchmarks

Computing and Math

Artificial Intelligence

OpenAI is reportedly struggling to improve its next big AI model. It's a warning for the entire AI industry.

Business Insider•Nov 12, 2024

Line go up.

Verge•Nov 13, 2024

Monthly inflation rate U.S. 2024

•Nov 14, 2024

Learn more about Metaculus NewsMatch

What will be state-of-the-art accuracy on the Massive Multitask dataset on the following dates?

94.7

What will be the best accuracy score on the MATH dataset by 2025?

0.95

What will the be the state-of-the-art performance on image classification on ImageNet in top-1 accuracy on the following dates?

91.9

Comments

? comments