Question

When will a Chinese entity develop a model surpassing GPT-4's few-shot performance on MMLU?

18 comments18

Total Forecasters62

Community Prediction2024-12-03

Make a Prediction

My Prediction

community

lower 25%

median

upper 75%

>2029-06-13

...

2024-09-27 08:45

2024-12-03 20:04

2025-04-04 04:03

1.2%

Authors:

Lawrence

Opened:

Closes:

Scheduled resolution:

Business of AI

AI in China

Computing and Math

Artificial Intelligence

China

List of companies of China

Can AI Speak Culture?

Psychology Today•Nov 18, 2024

Why the US Government Banned Investments in Some Chinese AI Startups

Wired•Nov 18, 2024

Mistral unveils new AI models and chat features

TechCrunch•Nov 19, 2024

Learn more about Metaculus NewsMatch

On January 1, 2025, which frontier AI lab will have a publicly available model with the highest score on the MMLU benchmark?

How many months after a Western actor trains a 1e26 FLOP model (~5x GPT-4) will a Chinese actor do so?

11.5

When will an AI model trained with the following orders of magnitude more compute than GPT-4 be released?

Comments

? comments