Question

Will high-impact research on reducing the sample complexity of Large Language Model pretraining be forthcoming before 2026?

6 comments6

Total Forecasters31

Community Prediction65%

Make a Prediction

community: 65%

median 65.0%mean 62.2%

Authors:

Lawrence

Opened:

Closes:

Scheduled resolution:

AI Training and Compute

AI Technical Benchmarks

Artificial Intelligence

When will a large language model with a context window of at least 5 million tokens be freely accessible to anyone?

2025-04-06

How many billions of parameters will the largest machine learning model trained before 2030 have?

2.43M

Will a dense machine learning model with at least 100 trillion parameters be trained before 2026?

28%

Comments

? comments

Authors:

Lawrence

Opened:

Closes:

Scheduled resolution:

AI Training and Compute

AI Technical Benchmarks

Artificial Intelligence

GPUs, CPUs And Serial Chips – Who’s Going To Be Manufacturing, And Who Will Be Begging For Help?

Forbes•Oct 22, 2024

LLMs in Medical School: A New Era of Learning

Psychology Today•Oct 22, 2024

Beyond Tools: LLMs and the Emergence of Extended Cognition

Psychology Today•Oct 23, 2024

Learn more about Metaculus NewsMatch

When will a large language model with a context window of at least 5 million tokens be freely accessible to anyone?

2025-04-06

How many billions of parameters will the largest machine learning model trained before 2030 have?

2.43M

Will a dense machine learning model with at least 100 trillion parameters be trained before 2026?

28%