Question

When will an AI be able to solve over 80% of competition-level coding problems on its first try?

18 comments18

Total Forecasters138

Community Prediction2027-02-22

Make a Prediction

My Prediction

community

lower 25%

median

upper 75%

>2081-06-20

...

2025-05-29 19:24

2027-02-22 05:32

2030-03-12 14:10

0.5%

Authors:

Matthew_Barnett

Opened:

Closes:

Scheduled resolution:

AI Demonstrations

Artificial Intelligence

Association for Computing Machinery

United States of America Computing Olympiad

Data analysis

Software engineering

IOI

AI coding assistants can help startups develop products, seed VCs believe

TechCrunch•Nov 7, 2024

Andreessen Horowitz Founders Notice A.I. Models Are Hitting a Ceiling

Observer (NY)•Nov 7, 2024

Anthropic is gaining on OpenAI in this key area of the AI market

Business Insider•Nov 7, 2024

Learn more about Metaculus NewsMatch

What will state-of-the-art top-1 accuracy on the APPS Benchmark introductory problems be from 2022 to 2025?

73.4

By what year will an AI achieve at least 85% on Francois Chollet's Abstraction and Reasoning Corpus?

2027-01-10

When will AI achieve competency on multi-choice questions across diverse fields of expertise (MMLU)?

2025-07-13

Comments

? comments