Question

What will be the best score in the 2019/2020 Winograd Schema AI challenge

Resolved :Ambiguous88.7

7 comments7

Total Forecasters77

Community Prediction88.7 (81.7 - 92.9)

Make a Prediction

PDF

CDF

My Prediction

community

lower 25%

median

upper 75%

...

81.68

88.67

92.95

What was the final result?Ambiguous

Authors:

Anthony

Opened:

Jun 16, 2018

Closes:

May 1, 2020

Resolves:

Dec 31, 2020

Computing and Math

Artificial Intelligence

2016-2020 Leaderboard

Winograd Schema Challenge

Hector Levesque

Nuance Communications

This DeepSeek demo shows how good the Chinese AI model is at math and reasoning

Business Insider•Jan 27, 2025

DeepSeek says its newest AI model, Janus-Pro can outperform Stable Diffusion and DALL-E 3.

Verge•Jan 28, 2025

OpenAI's o3 model aced a test of AI reasoning – but it's still not AGI

New Scientist•Jan 29, 2025

Learn more about Metaculus NewsMatch

What will be the best normalized score achieved on the original 7 RE-Bench tasks by December 31st 2025?

1.16

What will be the best score on Cybench by December 31st 2025?

70.8

What will be the best non-human SAT-style score on the hard subset of the QuALITY dataset by January 1, 2040?

98.2

Comments

? comments