Question

What will the highest Exact Match rate of the best-performing model on SQuAD2.0 be, at the end of 2022?

Resolved :90.9

1 comment1

Total Forecasters26

Community Prediction91.9

Make a Prediction

My Prediction

community

lower 25%

median

upper 75%

...

91.22

91.85

92.78

What was the final result?90.9

Community Baseline Score

71.2

Community Peer Score

18.5

Authors:

Tamay

Opened:

Closes:

Resolves:

AI Technical Benchmarks

Artificial Intelligence

OpenAI is reportedly struggling to improve its next big AI model. It's a warning for the entire AI industry.

Business Insider•Nov 12, 2024

Line go up.

Verge•Nov 13, 2024

OpenAI reportedly plans to launch an AI agent early next year

Verge•Nov 14, 2024

Learn more about Metaculus NewsMatch

What will be the best non-human SAT-style score on the hard subset of the QuALITY dataset by January 1, 2030?

96.6

What will be the best non-human SAT-style score on the hard subset of the QuALITY dataset by January 1, 2040?

98.2

What will be the best non-human SAT-style score on the hard subset of the QuALITY dataset by January 1, 2025?

81.7

Comments

? comments