Question

When will a Chinese entity develop a model surpassing GPT-4's few-shot performance on MMLU?

15 comments15

Total Forecasters62

Community Prediction2024-11-19

Make a Prediction

My Prediction

community

lower 25%

median

upper 75%

>2029-06-13

...

2024-09-23 07:52

2024-11-19 23:14

2025-03-08 18:25

1.0%

Authors:

Lawrence

Opened:

Closes:

Scheduled resolution:

Business of AI

AI in China

Computing and Math

Artificial Intelligence

China

List of companies of China

On January 1, 2025, which frontier AI lab will have a publicly available model with the highest score on the MMLU benchmark?

How many months after a Western actor trains a 1e26 FLOP model (~5x GPT-4) will a Chinese actor do so?

11.5

When will an AI model trained with the following orders of magnitude more compute than GPT-4 be released?

Comments

? comments

Authors:

Lawrence

Opened:

Closes:

Scheduled resolution:

Business of AI

AI in China

Computing and Math

Artificial Intelligence

China

List of companies of China

Google DeepMind CEO Demis Hassabis explains what needs to happen to move from chatbots to AGI

Business Insider•Oct 20, 2024

GPUs, CPUs And Serial Chips – Who’s Going To Be Manufacturing, And Who Will Be Begging For Help?

Forbes•Oct 22, 2024

LLMs in Medical School: A New Era of Learning

Psychology Today•Oct 22, 2024

Learn more about Metaculus NewsMatch

On January 1, 2025, which frontier AI lab will have a publicly available model with the highest score on the MMLU benchmark?

How many months after a Western actor trains a 1e26 FLOP model (~5x GPT-4) will a Chinese actor do so?

11.5