Question
When will an AI be able to solve over 80% of competition-level coding problems on its first try?
Total Forecasters138
Community Prediction2027-03-18 (2025-06-25 - 2030-02-03)
Make a Prediction
Authors:
Opened:
Closes:
Scheduled resolution:
What will state-of-the-art top-1 accuracy on the APPS Benchmark introductory problems be from 2022 to 2025?
73.4
When will AI achieve competency on multi-choice questions across diverse fields of expertise (MMLU)?
2025-08-04
When will an AI program be better than humans at making Metaculus forecasts?
2030-08-11
Comments
? comments
Authors:
Opened:
Closes:
Scheduled resolution:
What will state-of-the-art top-1 accuracy on the APPS Benchmark introductory problems be from 2022 to 2025?
73.4
When will AI achieve competency on multi-choice questions across diverse fields of expertise (MMLU)?
2025-08-04
When will an AI program be better than humans at making Metaculus forecasts?
2030-08-11