Question

Will the highest Elo LLM on Chatbot Arena be non-proprietary during 2024?

9 comments9

Total Forecasters38

Community Prediction0.1% (0.1% - 1%)

Make a Prediction

50%

community: 0.1%

Learn more about scores here.

Authors:

ADQ

Opened:

Closes:

Scheduled resolution:

Artificial Intelligence

Will there be a frontier open-source AI model on January 1 of the following years?

Will OpenAI's o1 remain the top LLM in all categories of Chatbot Arena on December 30, 2024?

14%

On January 1, 2025, which frontier AI lab will have a publicly available model with the highest score on the MMLU benchmark?

Comments

? comments

Authors:

ADQ

Opened:

Closes:

Scheduled resolution:

Artificial Intelligence

Will there be a frontier open-source AI model on January 1 of the following years?

Will OpenAI's o1 remain the top LLM in all categories of Chatbot Arena on December 30, 2024?

14%

Take Our 🏆Quarterly Cup🏆 Survey

MetaculusM

Will the highest Elo LLM on Chatbot Arena be non-proprietary during 2024?

Make a Prediction

Will there be a frontier open-source AI model on January 1 of the following years?

Will OpenAI's o1 remain the top LLM in all categories of Chatbot Arena on December 30, 2024?

On January 1, 2025, which frontier AI lab will have a publicly available model with the highest score on the MMLU benchmark?

Comments

Will there be a frontier open-source AI model on January 1 of the following years?

Will OpenAI's o1 remain the top LLM in all categories of Chatbot Arena on December 30, 2024?

On January 1, 2025, which frontier AI lab will have a publicly available model with the highest score on the MMLU benchmark?

Will there be a frontier open-source AI model on January 1 of the following years?

Will OpenAI's o1 remain the top LLM in all categories of Chatbot Arena on December 30, 2024?

On January 1, 2025, which frontier AI lab will have a publicly available model with the highest score on the MMLU benchmark?

Will there be a frontier open-source AI model on January 1 of the following years?

Will OpenAI's o1 remain the top LLM in all categories of Chatbot Arena on December 30, 2024?

On January 1, 2025, which frontier AI lab will have a publicly available model with the highest score on the MMLU benchmark?