HackerReposA FIELD GUIDE TO OPEN SOURCE
ProSponsor the shelf♧ 0
← Back to top all-time
floneum
kalosm
Rust2023–2024
floneum / kalosm

kalosm

Instant, controllable, local pre-trained AI models in Rust

2Distinct people
7Mentions
0Explicit recommenders
2.2KGitHub stars
REPOSITORY AT A GLANCE

What to know before exploring

What it is

Instant, controllable, local pre-trained AI models in Rust

GitHub

Where it is used

No documented product use has been verified yet.

What people are saying

No recommendation phrase was found in the indexed comments.

No classified warning is attached to this page. Read the discussions before treating silence as approval.

Also in these discussions

No other repository is repeatedly linked in the same discussions.

This week on Hacker News

Nov 9–Nov 16 UTC · Direct repository links and separately labeled related project stories. Indexed through 11/16/2026, 11:39:46 AM UTC.

No direct repository links were found in the indexed HN discussions over the past seven days. Older discussions are available below.

Mentions over time

HN mentions by month7 dated mentions

Observed mentions: 2023-07-12 16:53:48 UTC to 2024-03-29 01:49:10 UTC.

0122023-07-01 00:00:00 UTC to 2023-08-01 00:00:00 UTC (exclusive): 2 mentions; 1 submissions, 1 commentsJul 20232023-08-01 00:00:00 UTC to 2023-09-01 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2023-09-01 00:00:00 UTC to 2023-10-01 00:00:00 UTC (exclusive): 1 mentions; 0 submissions, 1 comments2023-10-01 00:00:00 UTC to 2023-11-01 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2023-11-01 00:00:00 UTC to 2023-12-01 00:00:00 UTC (exclusive): 1 mentions; 1 submissions, 0 commentsNov 20232023-12-01 00:00:00 UTC to 2024-01-01 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2024-01-01 00:00:00 UTC to 2024-02-01 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2024-02-01 00:00:00 UTC to 2024-03-01 00:00:00 UTC (exclusive): 2 mentions; 1 submissions, 1 comments2024-03-01 00:00:00 UTC to 2024-04-01 00:00:00 UTC (exclusive): 1 mentions; 0 submissions, 1 commentsMar 2024

Counts come from the repository’s dated source evidence. Index cutoff: 2026-11-02 08:16:59 UTC.

View mention counts and date ranges
UTC ranges include their start and exclude their end. Select a period to filter the source evidence.
PeriodStart (UTC)End (exclusive, UTC)MentionsSubmissionsComments
Jul 20232023-07-01 00:00:00 UTC2023-08-01 00:00:00 UTC211
Aug 20232023-08-01 00:00:00 UTC2023-09-01 00:00:00 UTC000
Sep 20232023-09-01 00:00:00 UTC2023-10-01 00:00:00 UTC101
Oct 20232023-10-01 00:00:00 UTC2023-11-01 00:00:00 UTC000
Nov 20232023-11-01 00:00:00 UTC2023-12-01 00:00:00 UTC110
Dec 20232023-12-01 00:00:00 UTC2024-01-01 00:00:00 UTC000
Jan 20242024-01-01 00:00:00 UTC2024-02-01 00:00:00 UTC000
Feb 20242024-02-01 00:00:00 UTC2024-03-01 00:00:00 UTC211
Mar 20242024-03-01 00:00:00 UTC2024-04-01 00:00:00 UTC101

What Hacker News says

1 sources

Show HN: Kalosm – a local first AI meta-framework in Rust

Kalosm is a meta-framework for AI written in Rust. Kalosm supports local quantized large language models like Llama, Mistral, Phi-1.5, and Zephyr. It also supports other quantized models like Wuerstchen, Segment Anything, and Whisper. In addition to local models, Kalosm supports remote models like GPT-4 and ada embeddings. What does Kalosm do? 1) Gather context from URLS, RSS feeds, web crawling, a search query, local files, or even your current surroundings! 2) Insert that context into an easily searchable vector database with Bert or a keyword search index 3) Generate text, images, or structured data with your context! One of the features I am most excited about is constrained generation which lets you control exactly what the language model outputs. This makes it possible for even very small models to generate coherent JSON or conform
Read the rest
to your custom grammar. It also unlocks advanced tool support with custom constraints for each tool input that ensures the text is valid. Why did I build Kalosm? I am currently working on a node editor for AI workflows called Floneum. I found that the existing tools didn't help users gather and integrate context with language models, so I built Kalosm. Kalosm will also enable Floneum to more easily gather context and richly integrate that context into multiple modalities. Everything in Kalosm is local first! Local context, local models, local inference: Kalosm is built from a laptop to run on your laptop. It doesn't require a powerful GPU to run any of the models Kalosm supports. Just download the library and start tinkering! If you are interested in Kalosm, have questions, or run into issues, consider joining the discord (https://discord.gg/dQdmhuB8q5)! I have tried to make kalosm easy to get started with, but if you run into issues or unclear APIs feel free to open an issue or discussion. There are over 20 examples throughout the repo and additional examples in the inline documentation. Every public API is documented if you run cargo doc. Let me know what you think about Kalosm. I would love to hear your feedback or feature suggestions! If you like it, consider giving it a star
4 points · Open discussion

MAKE YOURSELF AT HOME

A few shortcuts

/
Search the collection
?
Open this guide
Esc
Close dialogs and navigation

Your saved repositories and interests stay in this browser.