Skip to content

Latest commit

 

History

History

lmsys-multiturn

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
 
 
 
 

Top Chat Models (LMSys)

Optimized for extended conversations, this mix utilizes top-performing models in multi-turn interactions. It leverages the LMSys Chatbot Arena rankings for conversations with two or more turns, ensuring high-quality responses in longer dialogues. The weight is a function of the Elo score adjusted for number of votes and variance. Models with more consistently high votes will be weighed more heavily.

Categories

  • 💬 General
  • 🏆 Leaderboard
  • 🧠 Reasoning

Composition

This mix produces responses from the following models:

Model Weight %
"chatgpt-4o-latest" 53.92%
"gpt-4o-2024-05-13" 13.39%
"claude-3-5-sonnet-20240620" 12.67%
"gemini-1.5-pro-exp-0827" 9.09%
"gemini-1.5-pro-exp-0801" 8.13%
"gemini-1.5-pro-002" 2.80%

Update Frequency: Based on LMSys Source: https://lmarena.ai/