Question

What will the highest Exact Match rate of the best-performing model on SQuAD2.0 be on 2023-02-14?

Resolved :90.9

4 comments4

Total Forecasters30

Community Prediction92

Make a Prediction

My Prediction

community

lower 25%

median

upper 75%

>94

...

91.39

92.79

6.5%

What was the final result?90.9

Community Baseline Score

-2.9

Community Peer Score

40.9

Authors:

MetaculusOutlooks

Opened:

Closes:

Resolves:

Forecasting AI Progress

AI Technical Benchmarks

Forecasting AI Progress: Deep Learning Round

Artificial Intelligence

What will be the best non-human SAT-style score on the hard subset of the QuALITY dataset by January 1, 2040?

98.2

What will be the best non-human SAT-style score on the hard subset of the QuALITY dataset by January 1, 2030?

96.6

What will be the best non-human SAT-style score on the hard subset of the QuALITY dataset by January 1, 2025?

81.7

Comments

? comments