M

🚀Metaculus Open-Source Rewrite is Live!

You're now enjoying a rewritten, open-source Metaculus, with a range of improvements and new opportunities for collaboration. Go here to learn more!

Group

What will be the state-of-the-art language modelling performance (in perplexity) on WikiText-103 by the following dates?

28

Make a Prediction

TBD group labelresolution
25thmedian75th
community
<8
lower 25%
median
upper 75%
0.2%
15
15.6
15.7

What was the final result?15.8

Forecast Timeline

Authors:
casens
Opened:
Closes:
Scheduled resolution:
Forecasting AI Progress
AI Progress Essay Contest
AI Technical Benchmarks
Forecasting AI Progress: Hill Climbing Round
Forecasting AI Progress: Maximum Likelihood Round
Computing and Math
Artificial Intelligence
Artificial intelligence
Machine learning
Computer science
Information technology
Linguistics

Comments

? comments