Question

What will be the best score on the WebArena benchmark before 2025?

4 comments4

Total Forecasters10

Community Prediction64.9

Make a Prediction

My Prediction

community

lower 25%

median

upper 75%

...

58.59

64.86

72.36

Authors:

romeodean

Opened:

Closes:

Scheduled resolution:

AI Benchmarks

AI Technical Benchmarks

Artificial Intelligence

Machine learning

What will be the best score on the GAIA benchmark before 2025?

What will be the best score on the InterCode (Bash) benchmark before 2025?

55.6

What will be the best score on the SWE-Bench (unassisted) benchmark before 2025?

32.6

Comments

? comments

Authors:

romeodean

Opened:

Closes:

Scheduled resolution:

AI Benchmarks

AI Technical Benchmarks

Artificial Intelligence

Machine learning

OpenAI reportedly plans to launch an AI agent early next year

Verge•Nov 14, 2024

Operator will be with you shortly: OpenAI’s PC controlling AI agent coming in January 2025

•Nov 14, 2024

OpenAI set to launch ‘Operator’ in January — AI agents that can do tasks for you

•Nov 14, 2024

Learn more about Metaculus NewsMatch

What will be the best score on the GAIA benchmark before 2025?

What will be the best score on the InterCode (Bash) benchmark before 2025?

55.6

What will be the best score on the SWE-Bench (unassisted) benchmark before 2025?

32.6