Question

When will a Chinese entity develop a model surpassing GPT-4's few-shot performance on MMLU?

15 comments15

Total Forecasters62

Community Prediction2024-11-19

Make a Prediction

My Prediction

community

lower 25%

median

upper 75%

>2029-06-13

...

2024-09-23 07:52

2024-11-19 23:14

2025-03-08 18:25

1.0%

Authors:

Lawrence

Opened:

Closes:

Scheduled resolution:

Business of AI

AI in China

Computing and Math

Artificial Intelligence

China

List of companies of China

On January 1, 2025, which frontier AI lab will have a publicly available model with the highest score on the MMLU benchmark?

How many months after a Western actor trains a 1e26 FLOP model (~5x GPT-4) will a Chinese actor do so?

11.5

When will an AI model trained with the following orders of magnitude more compute than GPT-4 be released?

Comments

? comments

Authors:

Lawrence

Opened:

Closes:

Scheduled resolution:

Business of AI

AI in China

Computing and Math

Artificial Intelligence

China

List of companies of China

Propagandists around the world keep trying to use ChatGPT, according to OpenAI report

NBC•Oct 9, 2024

When Will AI Take Over the World? We Asked ChatGPT

Newsweek•Oct 10, 2024

The Techno-Agora: How LLMs Redefine Group Collaboration

Psychology Today•Oct 13, 2024

Learn more about Metaculus NewsMatch

On January 1, 2025, which frontier AI lab will have a publicly available model with the highest score on the MMLU benchmark?

How many months after a Western actor trains a 1e26 FLOP model (~5x GPT-4) will a Chinese actor do so?

11.5