Question

What will be the best perplexity score by a language model on the Penn Treebank (Word Level) by the end of 2024?

3 comments3

Total Forecasters15

Community Prediction14.7 (9.01 - 20.3)

Make a Prediction

weight:

My Prediction

community

lower 25%

median

upper 75%

...

9.012

14.74

20.28

Learn more about scores here.

Authors:

Matthew_Barnett

Opened:

Closes:

Scheduled resolution:

AI Progress Essay Contest

AI Technical Benchmarks

Computing and Math

Artificial Intelligence

2021-2025 Leaderboard

Perplexity acquires Carbon to connect AI search to your work files

TechCrunch•Dec 19, 2024

Perplexity AI triples its valuation in about 6 months with latest $500M funding round

Business Insider•Dec 19, 2024

Perplexity has reportedly closed a $500M funding round

TechCrunch•Dec 20, 2024

Learn more about Metaculus NewsMatch

When will a language model be developed that, when tested, yields approximately human-level output?

2024-06-05

What will be the state-of-the-art language modelling performance (in perplexity) on WikiText-103 by the following dates?

11.5

Human-Level Language Models

Comments

? comments

Authors:

Matthew_Barnett

Opened:

Closes:

Scheduled resolution:

AI Progress Essay Contest

AI Technical Benchmarks

Computing and Math

Artificial Intelligence

2021-2025 Leaderboard

Perplexity acquires Carbon to connect AI search to your work files

TechCrunch•Dec 19, 2024

Perplexity AI triples its valuation in about 6 months with latest $500M funding round

Business Insider•Dec 19, 2024

Perplexity has reportedly closed a $500M funding round

TechCrunch•Dec 20, 2024

Learn more about Metaculus NewsMatch

When will a language model be developed that, when tested, yields approximately human-level output?

2024-06-05

What will be the state-of-the-art language modelling performance (in perplexity) on WikiText-103 by the following dates?

11.5

Forecast 2025 With Future Perfect

MetaculusM

What will be the best perplexity score by a language model on the Penn Treebank (Word Level) by the end of 2024?

Make a Prediction

When will a language model be developed that, when tested, yields approximately human-level output?

What will be the state-of-the-art language modelling performance (in perplexity) on WikiText-103 by the following dates?

Human-Level Language Models

Comments

When will a language model be developed that, when tested, yields approximately human-level output?

What will be the state-of-the-art language modelling performance (in perplexity) on WikiText-103 by the following dates?

Human-Level Language Models

When will a language model be developed that, when tested, yields approximately human-level output?

What will be the state-of-the-art language modelling performance (in perplexity) on WikiText-103 by the following dates?

Human-Level Language Models

When will a language model be developed that, when tested, yields approximately human-level output?

What will be the state-of-the-art language modelling performance (in perplexity) on WikiText-103 by the following dates?

Human-Level Language Models