Question

Will high-impact research on reducing the sample complexity of Large Language Model pretraining be forthcoming before 2026?

7 comments7

Total Forecasters31

Community Prediction65%

Make a Prediction

community: 65%

median 65.0%mean 62.2%

Authors:

Lawrence

Opened:

Closes:

Scheduled resolution:

AI Training and Compute

AI Technical Benchmarks

Artificial Intelligence

ArXiv

Machine learning

Artificial intelligence

Computer science

Linguistics

Google Scholar

When will a large language model with a context window of at least 5 million tokens be freely accessible to anyone?

2025-04

How many billions of parameters will the largest machine learning model trained before 2030 have?

2.43M

Will a dense machine learning model with at least 100 trillion parameters be trained before 2026?

28%

Comments

? comments

Authors:

Lawrence

Opened:

Closes:

Scheduled resolution:

AI Training and Compute

AI Technical Benchmarks

Artificial Intelligence

ArXiv

Machine learning

Artificial intelligence

Computer science

Linguistics

Google Scholar

'A lot of money is going to get wasted': MIT economist sounds the alarm on AI hype

Business Insider•Oct 2, 2024

'A lot of money is going to get wasted': MIT economist sounds the alarm on AI hype

Business Insider•Oct 3, 2024

Is OpenAI building the next Google Search, or just selling bags of rice?

Business Insider•Oct 3, 2024

Learn more about Metaculus NewsMatch

When will a large language model with a context window of at least 5 million tokens be freely accessible to anyone?

2025-04

How many billions of parameters will the largest machine learning model trained before 2030 have?

2.43M

Will a dense machine learning model with at least 100 trillion parameters be trained before 2026?

28%

MetaculusM

🚀Metaculus Open-Source Rewrite is Live!

Will high-impact research on reducing the sample complexity of Large Language Model pretraining be forthcoming before 2026?

Make a Prediction

When will a large language model with a context window of at least 5 million tokens be freely accessible to anyone?

How many billions of parameters will the largest machine learning model trained before 2030 have?

Will a dense machine learning model with at least 100 trillion parameters be trained before 2026?

Comments

When will a large language model with a context window of at least 5 million tokens be freely accessible to anyone?

How many billions of parameters will the largest machine learning model trained before 2030 have?

Will a dense machine learning model with at least 100 trillion parameters be trained before 2026?

When will a large language model with a context window of at least 5 million tokens be freely accessible to anyone?

How many billions of parameters will the largest machine learning model trained before 2030 have?

Will a dense machine learning model with at least 100 trillion parameters be trained before 2026?

When will a large language model with a context window of at least 5 million tokens be freely accessible to anyone?

How many billions of parameters will the largest machine learning model trained before 2030 have?

Will a dense machine learning model with at least 100 trillion parameters be trained before 2026?