Question

What will the state-of-the-art performance on image classification on ImageNet be at 2021-06-14 in top-1 accuracy?

Resolved :86.886.6

8 comments8

Total Forecasters74

Community Prediction86.6 (86.5 - 87.1)

Make a Prediction

PDF

CDF

My Prediction

community

lower 25%

median

upper 75%

>95

...

86.46

86.57

87.05

0.3%

What was the final result?86.8

Community Baseline Score

42.1

Community Peer Score

42.7

Authors:

MetaculusOutlooks

Opened:

Dec 14, 2020

Closes:

Feb 13, 2021

Resolves:

Jun 15, 2021

Forecasting AI Progress

Forecasting AI Progress: Maximum Likelihood Round

Artificial Intelligence

2020-2021 Leaderboard

ImageNet

Database

Machine learning

DeepSeek says its newest AI model, Janus-Pro can outperform Stable Diffusion and DALL-E 3.

Verge•Jan 28, 2025

DeepSeek just dropped an update AI model called Janus Pro. It says the image generator is better than OpenAI's DALL-E.

Business Insider•Jan 28, 2025

What Is DeepSeek, the New Chinese OpenAI Rival?

Time•Jan 28, 2025

Learn more about Metaculus NewsMatch

What will the be the state-of-the-art performance on image classification on ImageNet in top-1 accuracy on the following dates?

91.9

What will the value of the herein defined Image Classification Performance Index be on 2026-12-14?

204

What will the state-of-the-art performance on one-shot image classification on miniImageNet be, on 2026-12-14 in accuracy, amongst models not trained on extra data?

Comments

? comments