Question

What will the state-of-the-art performance on one-shot image classification on miniImageNet be, at 2024-12-14 in accuracy?

Resolved :86.188.1

Total Forecasters49

Community Prediction88.1 (86.6 - 89.8)

Make a Prediction

PDF

CDF

	lower 25%	median	upper 75%	>92
community	86.56	88.07	89.84	10.2%
My Prediction	—	—	—	—

Quartiles	community	My Prediction
lower 25%	86.56	—
median	88.07	—
upper 75%	89.84	—
Upper bound
>92	10.2%	—

What was the final result?86.1

Community Baseline Score

0.3

Community Peer Score

12.8

Authors:

MetaculusOutlooks

Opened:

Jan 14, 2021

Closes:

Mar 13, 2023

Resolves:

Dec 13, 2024

Forecasting AI Progress

AI Progress Essay Contest

Forecasting AI Progress: Hill Climbing Round

Artificial Intelligence

2021-2025 Leaderboard

China’s DeepSeek claims theoretical cost-profit ratio of 545% per day

One America•Mar 4, 2025

Cohere claims its new Aya Vision AI model is best-in-class

TechCrunch•Mar 5, 2025

The hottest AI models, what they do, and how to use them

TechCrunch•Mar 6, 2025

Learn more about Metaculus NewsMatch

What will the state-of-the-art performance on one-shot image classification on miniImageNet be, on 2026-12-14 in accuracy, amongst models not trained on extra data?

What will the be the state-of-the-art performance on image classification on ImageNet in top-1 accuracy on the following dates?

91.9

What will be state-of-the-art accuracy on the Massive Multitask dataset on the following dates?

94.6

Comments

? comments