Question

What will the state-of-the-art performance on semantic segmentation of PASCAL-Context be at 2021-06-14 in mean IoU in percent (MIoU%)?

Resolved :60.559.3

4 comments4

Total Forecasters52

Community Prediction59.3 (59 - 60.3)

Make a Prediction

PDF

CDF

My Prediction

community

lower 25%

median

upper 75%

>65

...

58.99

59.32

60.31

1.2%

What was the final result?60.5

Community Baseline Score

0.4

Community Peer Score

19.8

Authors:

MetaculusOutlooks

Opened:

Dec 14, 2020

Closes:

Feb 14, 2021

Resolves:

Sep 28, 2021

Forecasting AI Progress

AI Technical Benchmarks

Forecasting AI Progress: Maximum Likelihood Round

Computing and Math

Artificial Intelligence

2020-2021 Leaderboard

Machine learning

DeepSeek ‘punctures’ AI leaders’ spending plans, and what analysts are saying

TechCrunch•Jan 27, 2025

DeepSeek says its newest AI model, Janus-Pro can outperform Stable Diffusion and DALL-E 3.

Verge•Jan 28, 2025

DeepSeek just dropped an update AI model called Janus Pro. It says the image generator is better than OpenAI's DALL-E.

Business Insider•Jan 28, 2025

Learn more about Metaculus NewsMatch

What will the value of the herein defined Image Classification Performance Index be on 2026-12-14?

204

What will the be the state-of-the-art performance on image classification on ImageNet in top-1 accuracy on the following dates?

91.9

What will be state-of-the-art accuracy on the Massive Multitask dataset on the following dates?

94.6

Comments

? comments