WAwanderingmind·Apr 10, 2024Submission
1 points · Open discussionOpenGenerativeAI
llm-colosseum
Jupyter Notebook2024–2024
OpenGenerativeAI / llm-colosseum
llm-colosseum
Benchmark LLMs by fighting in Street Fighter 3! The new way to evaluate the quality of an LLM
3Distinct people
4Mentions
0Explicit recommenders
1.5KGitHub stars
What to know before exploring
What it is
Benchmark LLMs by fighting in Street Fighter 3! The new way to evaluate the quality of an LLM
GitHub
Where it is used
No documented product use has been verified yet.
What people are saying
No recommendation phrase was found in the indexed comments.
No classified warning is attached to this page. Read the discussions before treating silence as approval.
Also in these discussions
No other repository is repeatedly linked in the same discussions.
This week on Hacker News
Nov 7–Nov 14 UTC · Direct repository links and separately labeled related project stories. Indexed through 11/14/2026, 5:04:57 PM UTC.
No direct repository links were found in the indexed HN discussions over the past seven days. Older discussions are available below.
Mentions over time
HN mentions by day4 dated mentions
Observed mentions: 2024-03-27 17:16:41 UTC to 2024-04-10 11:59:51 UTC.
Counts come from the repository’s dated source evidence. Index cutoff: 2026-11-02 08:16:59 UTC.
View mention counts and date ranges
| Period | Start (UTC) | End (exclusive, UTC) | Mentions | Submissions | Comments |
|---|---|---|---|---|---|
| Mar 27 | 2024-03-27 00:00:00 UTC | 2024-03-28 00:00:00 UTC | 2 | 1 | 1 |
| Mar 28 | 2024-03-28 00:00:00 UTC | 2024-03-29 00:00:00 UTC | 0 | 0 | 0 |
| Mar 29 | 2024-03-29 00:00:00 UTC | 2024-03-30 00:00:00 UTC | 0 | 0 | 0 |
| Mar 30 | 2024-03-30 00:00:00 UTC | 2024-03-31 00:00:00 UTC | 0 | 0 | 0 |
| Mar 31 | 2024-03-31 00:00:00 UTC | 2024-04-01 00:00:00 UTC | 0 | 0 | 0 |
| Apr 1 | 2024-04-01 00:00:00 UTC | 2024-04-02 00:00:00 UTC | 0 | 0 | 0 |
| Apr 2 | 2024-04-02 00:00:00 UTC | 2024-04-03 00:00:00 UTC | 0 | 0 | 0 |
| Apr 3 | 2024-04-03 00:00:00 UTC | 2024-04-04 00:00:00 UTC | 0 | 0 | 0 |
| Apr 4 | 2024-04-04 00:00:00 UTC | 2024-04-05 00:00:00 UTC | 0 | 0 | 0 |
| Apr 5 | 2024-04-05 00:00:00 UTC | 2024-04-06 00:00:00 UTC | 0 | 0 | 0 |
| Apr 6 | 2024-04-06 00:00:00 UTC | 2024-04-07 00:00:00 UTC | 0 | 0 | 0 |
| Apr 7 | 2024-04-07 00:00:00 UTC | 2024-04-08 00:00:00 UTC | 0 | 0 | 0 |
| Apr 8 | 2024-04-08 00:00:00 UTC | 2024-04-09 00:00:00 UTC | 1 | 1 | 0 |
| Apr 9 | 2024-04-09 00:00:00 UTC | 2024-04-10 00:00:00 UTC | 0 | 0 | 0 |
| Apr 10 | 2024-04-10 00:00:00 UTC | 2024-04-11 00:00:00 UTC | 1 | 1 | 0 |
What Hacker News says
4 sourcesEvaluate LLMs in Real Time with Street Fighter III
1 points · Open discussionLLM Colosseum: Make LLMs fight in SFIII
3 points · Open discussionHello guys,
Tired of current boring LLMs benchmark ? I'm sharing with you a fun project built during the Mistral AI SF hackathon.
Using a RL framework, we made LLMs fight against each other in real time in Street Fighter III. You can find the repo here : https://github.com/OpenGenerativeAI/llm-colosseum.
Aside from the fact that it's very funny to see Mistral and others performing Hadouken, we found that it is a great way to benchmark language models. They need to quickly understand their environment and take actions accordingly.
With >400 fights, check out the ELO ranking on the HF space here : https://huggingface.co/spaces/junior-labs/llm-colosseum
In LLM Colosseum: Make LLMs fight in SFIII