Question

What will the highest Exact Match rate of the best-performing model on SQuAD2.0 be on 2022-01-14?

Resolved :90.9

4 comments4

Total Forecasters39

Community Prediction91.1

Make a Prediction

My Prediction

community

lower 25%

median

upper 75%

>93.1

...

90.93

91.13

91.41

0.5%

What was the final result?90.9

Community Baseline Score

43.6

Community Peer Score

31.8

Authors:

MetaculusOutlooks

Opened:

Closes:

Resolves:

Forecasting AI Progress

Forecasting AI Progress: Hill Climbing Round

Artificial Intelligence

What will be the best non-human SAT-style score on the hard subset of the QuALITY dataset by January 1, 2030?

96.6

What will be the best non-human SAT-style score on the hard subset of the QuALITY dataset by January 1, 2025?

81.7

What will be the best non-human SAT-style score on the hard subset of the QuALITY dataset by January 1, 2040?

98.2

Comments

? comments