Question

What will the highest Exact Match rate of the best-performing model on SQuAD2.0 be, at the end of 2022?

Resolved :90.991.9

1 comment1

Total Forecasters26

Community Prediction91.9 (91.2 - 92.8)

Make a Prediction

My Prediction

community

lower 25%

median

upper 75%

...

91.22

91.85

92.78

What was the final result?90.9

Community Baseline Score

71.2

Community Peer Score

18.5

Learn more about scores here.

Authors:

Tamay

Opened:

Closes:

Resolves:

AI Technical Benchmarks

Artificial Intelligence

2016-2025 Leaderboard

AI near-aces college entry-level Korean exam

Korea Herald•Dec 17, 2024

Language AIs in 2024: Size, guardrails and steps toward AI agents

The Conversation•Dec 20, 2024

OpenAI Upgrades Its Smartest AI Model With Improved Reasoning Skills

Wired•Dec 21, 2024

Learn more about Metaculus NewsMatch

What will be the best non-human SAT-style score on the hard subset of the QuALITY dataset by January 1, 2030?

96.9

What will be the best non-human SAT-style score on the hard subset of the QuALITY dataset by January 1, 2040?

98.2

What will be the best non-human SAT-style score on the hard subset of the QuALITY dataset by January 1, 2025?

78.9

Comments

? comments