Question

What will the highest Exact Match rate of the best-performing model on SQuAD2.0 be on 2022-01-14?

Resolved :90.991.1

4 comments4

Total Forecasters39

Community Prediction91.1 (90.9 - 91.4)

Make a Prediction

My Prediction

community

lower 25%

median

upper 75%

>93.1

...

90.93

91.13

91.41

0.5%

What was the final result?90.9

Community Baseline Score

43.6

Community Peer Score

31.8

Learn more about scores here.

Authors:

MetaculusOutlooks

Opened:

Closes:

Resolves:

Forecasting AI Progress

Forecasting AI Progress: Hill Climbing Round

Artificial Intelligence

Will 2025 Be a "Technology Wake-Up Call" for Clinicians?

Psychology Today•Dec 20, 2024

Predictions for AI in 2025: Collaborative Agents, AI Skepticism, and New Risks

•Dec 24, 2024

OpenAI Upgrades Its Smartest AI Model With Improved Reasoning Skills

Wired•Dec 21, 2024

Learn more about Metaculus NewsMatch

What will be the best non-human SAT-style score on the hard subset of the QuALITY dataset by January 1, 2030?

96.9

What will be the best non-human SAT-style score on the hard subset of the QuALITY dataset by January 1, 2025?

78.9

What will be the best non-human SAT-style score on the hard subset of the QuALITY dataset by January 1, 2040?

98.2

Comments

? comments