MAmagdyks·Feb 1, 2024Submission
LoRAX: Hot swap LoRA adapters to serve many finetuned models concurrently
3 points · Open discussionpredibase
lorax
Python2023–2024
predibase / lorax · Archived
lorax
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
6Distinct people
6Mentions
0Explicit recommenders
3.8KGitHub stars
What to know before exploring
What it is
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
GitHub
Where it is used
No documented product use has been verified yet.
What people are saying
No recommendation phrase was found in the indexed comments.
No classified warning is attached to this page. Read the discussions before treating silence as approval.
Also in these discussions
No other repository is repeatedly linked in the same discussions.
This week on Hacker News
Nov 7–Nov 14 UTC · Direct repository links and separately labeled related project stories. Indexed through 11/14/2026, 3:03:16 PM UTC.
No direct repository links were found in the indexed HN discussions over the past seven days. Older discussions are available below.
Mentions over time
HN mentions by week6 dated mentions
Observed mentions: 2023-11-16 16:21:58 UTC to 2024-02-01 21:22:06 UTC. Weeks start Monday, UTC.
Counts come from the repository’s dated source evidence. Index cutoff: 2026-11-02 08:16:59 UTC.
View mention counts and date ranges
| Period | Start (UTC) | End (exclusive, UTC) | Mentions | Submissions | Comments |
|---|---|---|---|---|---|
| Nov 13 | 2023-11-13 00:00:00 UTC | 2023-11-20 00:00:00 UTC | 1 | 1 | 0 |
| Nov 20 | 2023-11-20 00:00:00 UTC | 2023-11-27 00:00:00 UTC | 0 | 0 | 0 |
| Nov 27 | 2023-11-27 00:00:00 UTC | 2023-12-04 00:00:00 UTC | 2 | 1 | 1 |
| Dec 4 | 2023-12-04 00:00:00 UTC | 2023-12-11 00:00:00 UTC | 0 | 0 | 0 |
| Dec 11 | 2023-12-11 00:00:00 UTC | 2023-12-18 00:00:00 UTC | 1 | 0 | 1 |
| Dec 18 | 2023-12-18 00:00:00 UTC | 2023-12-25 00:00:00 UTC | 0 | 0 | 0 |
| Dec 25 | 2023-12-25 00:00:00 UTC | 2024-01-01 00:00:00 UTC | 0 | 0 | 0 |
| Jan 1 | 2024-01-01 00:00:00 UTC | 2024-01-08 00:00:00 UTC | 0 | 0 | 0 |
| Jan 8 | 2024-01-08 00:00:00 UTC | 2024-01-15 00:00:00 UTC | 0 | 0 | 0 |
| Jan 15 | 2024-01-15 00:00:00 UTC | 2024-01-22 00:00:00 UTC | 0 | 0 | 0 |
| Jan 22 | 2024-01-22 00:00:00 UTC | 2024-01-29 00:00:00 UTC | 0 | 0 | 0 |
| Jan 29 | 2024-01-29 00:00:00 UTC | 2024-02-05 00:00:00 UTC | 2 | 1 | 1 |
What Hacker News says
6 sourcesLoRAX [0] does sound super helpful and so I’d be curious if there are some good examples of people applying it. What are some current working deployments where one has 100s or 1000s of LoRA fine tuned models? I guess I can make up stuff that makes sense, so that’s not really what I’m asking, I’m interested in learning about any known deployments and example setups.
[0] https://github.com/predibase/lorax
In Mistral CEO confirms 'leak' of new open source AI model nearing GPT4 performanceLooks kind of inactive.
https://github.com/predibase/lorax
Does a similar thing and seems more active.
In S-LoRA: Serving Concurrent LoRA Adaptershttps://github.com/predibase/lorax does this, it's not that slow, since LoRAs aren't usually very big.
In Are Open-Source Large Language Models Catching Up?LoRAX: Serve 100s of Fine-tuned LLMs for the Cost of 1
2 points · Open discussionLorax: Serve 100s of Fine-Tuned LLMs in Production for the Cost of 1
5 points · Open discussion