Group

What percentage of problems from Long Code Arena do you estimate the top-performing AI model or agent will be able to solve by December'25?

no comments0

Make a Prediction

This question is in the Upcoming stage, and will be open for predictions soon

Long Code Arena benchmarks

median

PDF

Authors:

ilia.zaharov

Opens:

Mar 20, 2025

Closes:

Nov 30, 2025

Scheduled resolution:

Dec 14, 2025

JetBrains

Artificial Intelligence

Silicon Valley's next act: bringing 'vibe coding' to the world

Business Insider•Feb 13, 2025

LogicStar is building AI agents for app maintenance

TechCrunch•Feb 15, 2025

These researchers used NPR Sunday Puzzle questions to benchmark AI ‘reasoning’ models

TechCrunch•Feb 17, 2025

Learn more about Metaculus NewsMatch

For these benchmarks, what percentage of problems do you estimate the top-performing AI model or agent will be able to solve by December'25?

When will an AI be able to solve over 80% of competition-level coding problems on its first try?

2027-02-28

What will state-of-the-art top-1 accuracy on the APPS Benchmark introductory problems be from 2022 to 2025?

73.4

Comments

? comments