Question

What will the state-of-the-art performance on semantic segmentation on Cityscapes be on 2023-02-14 in mean IoU in percent (MIoU%), amongst models not trained on extra data?

Resolved :84.484.5

2 comments2

Total Forecasters29

Community Prediction84.5 (83.6 - 85.6)

Make a Prediction

PDF

CDF

My Prediction

community

lower 25%

median

upper 75%

>90

...

83.61

84.48

85.64

1.3%

What was the final result?84.4

Community Baseline Score

29.3

Community Peer Score

21.4

Authors:

MetaculusOutlooks

Opened:

Feb 14, 2021

Closes:

Apr 14, 2021

Resolves:

Feb 14, 2023

Forecasting AI Progress

AI Technical Benchmarks

Forecasting AI Progress: Deep Learning Round

Artificial Intelligence

2021-2025 Leaderboard

DeepSeek says its newest AI model, Janus-Pro can outperform Stable Diffusion and DALL-E 3.

Verge•Jan 28, 2025

DeepSeek just dropped an update AI model called Janus Pro. It says the image generator is better than OpenAI's DALL-E.

Business Insider•Jan 28, 2025

Viral AI company DeepSeek releases new image model family

TechCrunch•Jan 28, 2025

Learn more about Metaculus NewsMatch

What will the state-of-the-art performance on one-shot image classification on miniImageNet be, on 2026-12-14 in accuracy, amongst models not trained on extra data?

What will the be the state-of-the-art performance on image classification on ImageNet in top-1 accuracy on the following dates?

91.9

What will the value of the herein defined Image Classification Performance Index be on 2026-12-14?

204

Comments

? comments