Question

What will be the best score on the InterCode (Bash) benchmark before 2025?

1 comment1

Total Forecasters11

Community Prediction55.6

Make a Prediction

My Prediction

community

lower 25%

median

upper 75%

...

48.87

55.63

65.7

Authors:

romeodean

Opened:

Closes:

Scheduled resolution:

AI Technical Benchmarks

AI Benchmarks

Artificial Intelligence

What will be the best score on the WebArena benchmark before 2025?

64.9

What will be the best score on the GAIA benchmark before 2025?

What will be the best score on the SWE-Bench (unassisted) benchmark before 2025?

32.6

Comments

? comments

Authors:

romeodean

Opened:

Closes:

Scheduled resolution:

AI Technical Benchmarks

AI Benchmarks

Artificial Intelligence

OpenAI reportedly plans to launch an AI agent early next year

Verge•Nov 14, 2024

Operator will be with you shortly: OpenAI’s PC controlling AI agent coming in January 2025

•Nov 14, 2024

OpenAI set to launch ‘Operator’ in January — AI agents that can do tasks for you

•Nov 14, 2024

Learn more about Metaculus NewsMatch

What will be the best score on the WebArena benchmark before 2025?

64.9

What will be the best score on the GAIA benchmark before 2025?

What will be the best score on the SWE-Bench (unassisted) benchmark before 2025?

32.6