Take Our 🏆Quarterly Cup🏆 Survey

We're considering changes to the Quarterly Cup and want to hear from you, take our short survey to share your thoughts and help shape future iterations of the Cup.

M

Question

What will the highest Exact Match rate of the best-performing model on SQuAD2.0 be on 2023-02-14?

Resolved :90.992
1
4
Total Forecasters30
Community Prediction92 (91.4 - 92.8)

Make a Prediction

My Prediction
community
lower 25%
median
upper 75%
>94
...
...
...
...
91.39
92
92.79
6.5%

What was the final result?90.9

Community Baseline Score
-2.9
Community Peer Score
40.9
Learn more about scores here.
Authors:
MetaculusOutlooks
Opened:
Closes:
Resolves:
Forecasting AI Progress
AI Technical Benchmarks
Forecasting AI Progress: Deep Learning Round
Artificial Intelligence
2021-2025 Leaderboard
Culture
History
Machine learning
Stanford University
Wikipedia
Education

Comments

? comments