This time let’s talk about Github 33.5k FastChat project, which is an open platform for training, serving, and evaluating chatbots based on large language models.
It provides support for Chatbot Arena, whichCollected 70+ large models for usersfreeuse, and are ranked based on user votes.
Large model ranking address: https://chat.lmsys.org/?leaderboard
Ranking |
Model Name |
Average score |
Developers |
1 |
GPT-4-Turbo-2024-04-09 |
1260 |
OpenAI |
1 |
Claude 3 Opus |
1255 |
Anthropic |
1 |
GPT-4-1106-preview |
1254 |
OpenAI |
2 |
GPT-4-0125-preview |
1250 |
OpenAI |
5 |
Bard (Gemini Pro) |
1209 |
|
5 |
Claude 3 Sonnet |
1203 |
Anthropic |
7 |
Command R+ |
1193 |
Cohere |
7 |
GPT-4-0314 |
1189 |
OpenAI |
9 |
Claude 3 Haiku |
1182 |
Anthropic |
10 |
GPT-4-0613 |
1164 |
OpenAI |
10 |
Mistral-Large-2402 |
1158 |
Mistral |
11 |
Qwen1.5-72B-Chat |
1154 |
Alibaba |
12 |
Claude-1 |
1150 |
Anthropic |
In Chatbot Arena, we canFree access to 30+ large models including Claude-3, ChatGPT4 and Gemini Pro, and provides users withFour types of conversations, each way allows for an ongoing conversation.
Chatbot Arena: https://chat.lmsys.org/
Next, I will introduce these four methods to you respectively:
Two big models PK
There are two ways to play two big models PK:
- Anonymous large model PK : Select the "Arena(battle)", it will provide two anonymous models (such as ChatGPT, Claude, Llama) to users, and users will vote for their favorite one after using it!
For example, let’s ask the following question:
As you can see, the two models will answer together, and then we can choose A is better or B is better based on the answer. After the selection, the names of the two models will be told to us.
If you are not satisfied with the answer, you can select "Regenerate" to regenerate the answer, or directly start a new "New Round".
- Choose any two large models to PK : Select theArena (side-by-side)", under this tab we can select any two large models to ask questions.
In addition to PK chat, direct chat with a single model is also supported.
Single Model Chat
Select theDirect Chat"You can select a single model to have a conversation just like you usually do with ChatGPT.
There are many models, you can choose:
Parsing pictures
Select theVision Direct Chat", you can have a picture conversation, each conversation can only use one image to chat. And the image size must be less than 15 MB.
All the big models on this website are free to use, so we can use them as much as we want.
If you are interested, go and try it.