Question

What will the highest Exact Match rate of the best-performing model on SQuAD2.0 be on 2021-06-14?

Resolved :90.9

1 comment1

Total Forecasters60

Community Prediction90.8

Make a Prediction

My Prediction

community

lower 25%

median

upper 75%

>92.9

...

90.74

90.84

91.1

1.2%

What was the final result?90.9

Community Baseline Score

42.6

Community Peer Score

21.7

Authors:

MetaculusOutlooks

Opened:

Closes:

Resolves:

Forecasting AI Progress

Forecasting AI Progress: Maximum Likelihood Round

Artificial Intelligence

What will be the best non-human SAT-style score on the hard subset of the QuALITY dataset by January 1, 2025?

81.7

What will be the best non-human SAT-style score on the hard subset of the QuALITY dataset by January 1, 2030?

96.6

What will be the best non-human SAT-style score on the hard subset of the QuALITY dataset by January 1, 2040?

98.2

Comments

? comments