Question

Will transformer derived architectures still be state of the art for language modeling in December 2025?

8 comments8

Total Forecasters61

Community Prediction85%

Make a Prediction

community: 85%

median 85.0%mean 84.0%

Authors:

Matthew_Barnett

Opened:

Closes:

Scheduled resolution:

AI Training and Compute

AI Technical Benchmarks

Artificial Intelligence

Neuroscience

Rnn (software)

Long short-term memory

Artificial intelligence

Will transformer models be the state-of-the-art on most natural language processing benchmarks on January 1, 2027?

72%

Will transformer derived architectures accelerate progress in deep learning?

32%

Will high-impact research on reducing the sample complexity of Large Language Model pretraining be forthcoming before 2026?

65%

Comments

? comments

Authors:

Matthew_Barnett

Opened:

Closes:

Scheduled resolution:

AI Training and Compute

AI Technical Benchmarks

Artificial Intelligence

Neuroscience

Rnn (software)

Long short-term memory

Artificial intelligence

SoftBank to Invest $500M in OpenAI for the First Time—Is It Late to the Party?

Observer (NY)•Oct 1, 2024

Here's what OpenAI employees are saying about the company's future

Business Insider•Oct 1, 2024

Powering Data Centers Is A Herculean Task

Forbes•Oct 1, 2024

Learn more about Metaculus NewsMatch

Will transformer models be the state-of-the-art on most natural language processing benchmarks on January 1, 2027?

72%

Will transformer derived architectures accelerate progress in deep learning?

32%

Will high-impact research on reducing the sample complexity of Large Language Model pretraining be forthcoming before 2026?

65%

MetaculusM

🚀Metaculus Open-Source Rewrite is Live!

Will transformer derived architectures still be state of the art for language modeling in December 2025?

Make a Prediction

Will transformer models be the state-of-the-art on most natural language processing benchmarks on January 1, 2027?

Will transformer derived architectures accelerate progress in deep learning?

Will high-impact research on reducing the sample complexity of Large Language Model pretraining be forthcoming before 2026?

Comments

Will transformer models be the state-of-the-art on most natural language processing benchmarks on January 1, 2027?

Will transformer derived architectures accelerate progress in deep learning?

Will high-impact research on reducing the sample complexity of Large Language Model pretraining be forthcoming before 2026?

Will transformer models be the state-of-the-art on most natural language processing benchmarks on January 1, 2027?

Will transformer derived architectures accelerate progress in deep learning?

Will high-impact research on reducing the sample complexity of Large Language Model pretraining be forthcoming before 2026?

Will transformer models be the state-of-the-art on most natural language processing benchmarks on January 1, 2027?

Will transformer derived architectures accelerate progress in deep learning?

Will high-impact research on reducing the sample complexity of Large Language Model pretraining be forthcoming before 2026?