Question

What will the state-of-the-art performance on semantic segmentation on Cityscapes be at 2022-01-14 in mean IoU in percent (MIoU%)?

Resolved :84.483.7

Total Forecasters35

Community Prediction83.7 (83.4 - 84.3)

Make a Prediction

PDF

CDF

	lower 25%	median	upper 75%	>88
community	83.42	83.73	84.33	1.2%
My Prediction	—	—	—	—

Quartiles	community	My Prediction
lower 25%	83.42	—
median	83.73	—
upper 75%	84.33	—
Upper bound
>88	1.2%	—

What was the final result?84.4

Community Baseline Score

8.4

Community Peer Score

33.9

Authors:

MetaculusOutlooks

Opened:

Jan 14, 2021

Closes:

Mar 13, 2021

Resolves:

Mar 22, 2022

Forecasting AI Progress

AI Technical Benchmarks

Forecasting AI Progress: Hill Climbing Round

Artificial Intelligence

DeepSeek claims ‘theoretical’ profit margins of 545%

TechCrunch•Mar 2, 2025

China’s DeepSeek claims theoretical cost-profit ratio of 545% per day

One America•Mar 4, 2025

People are using Super Mario to benchmark AI now

TechCrunch•Mar 4, 2025

Learn more about Metaculus NewsMatch

What will the state-of-the-art performance on one-shot image classification on miniImageNet be, on 2026-12-14 in accuracy, amongst models not trained on extra data?

What will the be the state-of-the-art performance on image classification on ImageNet in top-1 accuracy on the following dates?

91.9

What will be state-of-the-art accuracy on the Massive Multitask dataset on the following dates?

94.6

Comments

? comments