EVEvan-Almloff·Mar 29, 2024
It is pretty good. I am working on an application that uses SVGs as a way to draw a workflow editor UI with Dioxus: https://github.com/floneum/floneum
In Dioxus 0.5: Web, Desktop, Mobile Apps in Rustfloneum
kalosm
Rust2023–2024
floneum / kalosm
kalosm
Instant, controllable, local pre-trained AI models in Rust
2Distinct people
7Mentions
0Explicit recommenders
2.2KGitHub stars
What to know before exploring
What it is
Instant, controllable, local pre-trained AI models in Rust
GitHub
Where it is used
No documented product use has been verified yet.
What people are saying
No recommendation phrase was found in the indexed comments.
No classified warning is attached to this page. Read the discussions before treating silence as approval.
Also in these discussions
No other repository is repeatedly linked in the same discussions.
This week on Hacker News
Nov 7–Nov 14 UTC · Direct repository links and separately labeled related project stories. Indexed through 11/14/2026, 5:04:57 PM UTC.
No direct repository links were found in the indexed HN discussions over the past seven days. Older discussions are available below.
Mentions over time
HN mentions by month7 dated mentions
Observed mentions: 2023-07-12 16:53:48 UTC to 2024-03-29 01:49:10 UTC.
Counts come from the repository’s dated source evidence. Index cutoff: 2026-11-02 08:16:59 UTC.
View mention counts and date ranges
| Period | Start (UTC) | End (exclusive, UTC) | Mentions | Submissions | Comments |
|---|---|---|---|---|---|
| Jul 2023 | 2023-07-01 00:00:00 UTC | 2023-08-01 00:00:00 UTC | 2 | 1 | 1 |
| Aug 2023 | 2023-08-01 00:00:00 UTC | 2023-09-01 00:00:00 UTC | 0 | 0 | 0 |
| Sep 2023 | 2023-09-01 00:00:00 UTC | 2023-10-01 00:00:00 UTC | 1 | 0 | 1 |
| Oct 2023 | 2023-10-01 00:00:00 UTC | 2023-11-01 00:00:00 UTC | 0 | 0 | 0 |
| Nov 2023 | 2023-11-01 00:00:00 UTC | 2023-12-01 00:00:00 UTC | 1 | 1 | 0 |
| Dec 2023 | 2023-12-01 00:00:00 UTC | 2024-01-01 00:00:00 UTC | 0 | 0 | 0 |
| Jan 2024 | 2024-01-01 00:00:00 UTC | 2024-02-01 00:00:00 UTC | 0 | 0 | 0 |
| Feb 2024 | 2024-02-01 00:00:00 UTC | 2024-03-01 00:00:00 UTC | 2 | 1 | 1 |
| Mar 2024 | 2024-03-01 00:00:00 UTC | 2024-04-01 00:00:00 UTC | 1 | 0 | 1 |
What Hacker News says
7 sourcesShow HN: Kalosm an embeddable framework for pre-trained models in Rust
Hi everyone, I'm happy to announce the release of Kalosm! [Kalosm](https://floneum.com/kalosm/) is a framework for embedded AI in rust.
## What is Kalosm?
Kalosm provides a simple interface for pre-trained language, audio, and image models models. To make it easy to use with these models in your application, Kalosm includes a set of integrations other systems like your database or documents.
```rust
use kalosm::language::*;
#[tokio::main]
async fn main() {
let mut model = Llama::new_chat();
let mut chat = Chat::builder(&mut model)
.with_system_prompt("The assistant will act like a pirate")
.build();
loop {
chat.add_message(prompt_input("\n> ").unwrap())
.await
.unwrap()
.to_std_out()
.await
.unwrap();
}
}
```
## What can you build with Kal
Read the rest
osm?
Kalosm is designed to be a flexible and powerful tool for building AI into your applications. It is a great fit for any application that uses AI models to process sensitive information where local processing is important.
Here are a few examples of applications that are built with Kalosm:
- Floneum (https://floneum.com/): A local open source workflow editor and automation tool that uses Kalosm to provide natural language processing and other AI features.
- Kalosm Chat (https://github.com/floneum/kalosm-chat): A simple chat application that uses Kalosm to run quantized language models.
## Kalosm 0.2
The 0.2 release includes several new features and some performance improvements:
- Tasks and Agents
- Task Evaluation
- Prompt Auto-Tuning
- Regex Validation
- Surreal Database Integration
- RAG improvements
- Performance Improvements
- New Models
If you have any questions, feel free to ask them here, in the discord (https://discord.gg/dQdmhuB8q5) or on GitHub (https://github.com/floneum/floneum/tree/master/interfaces/ka...).
To get started with Kalosm, you can follow the quick start guide: https://floneum.com/kalosm/docs/
This reminds me of Floneum (https://github.com/floneum/floneum), this open-sourced tool for graph-based workflows using local LLMs.
More for personal use and not quite as polished but a decent alternative for those looking to play around with the idea locally.
In Launch HN: AgentHub (YC W24) – A no-code automation platformShow HN: Kalosm – a local first AI meta-framework in Rust
Kalosm is a meta-framework for AI written in Rust. Kalosm supports local quantized large language models like Llama, Mistral, Phi-1.5, and Zephyr. It also supports other quantized models like Wuerstchen, Segment Anything, and Whisper. In addition to local models, Kalosm supports remote models like GPT-4 and ada embeddings.
What does Kalosm do?
1) Gather context from URLS, RSS feeds, web crawling, a search query, local files, or even your current surroundings!
2) Insert that context into an easily searchable vector database with Bert or a keyword search index
3) Generate text, images, or structured data with your context!
One of the features I am most excited about is constrained generation which lets you control exactly what the language model outputs. This makes it possible for even very small models to generate coherent JSON or conform
Read the rest
to your custom grammar. It also unlocks advanced tool support with custom constraints for each tool input that ensures the text is valid.
Why did I build Kalosm?
I am currently working on a node editor for AI workflows called Floneum. I found that the existing tools didn't help users gather and integrate context with language models, so I built Kalosm. Kalosm will also enable Floneum to more easily gather context and richly integrate that context into multiple modalities.
Everything in Kalosm is local first!
Local context, local models, local inference: Kalosm is built from a laptop to run on your laptop. It doesn't require a powerful GPU to run any of the models Kalosm supports. Just download the library and start tinkering!
If you are interested in Kalosm, have questions, or run into issues, consider joining the discord (https://discord.gg/dQdmhuB8q5)!
I have tried to make kalosm easy to get started with, but if you run into issues or unclear APIs feel free to open an issue or discussion. There are over 20 examples throughout the repo and additional examples in the inline documentation. Every public API is documented if you run cargo doc.
Let me know what you think about Kalosm. I would love to hear your feedback or feature suggestions! If you like it, consider giving it a star
Floneum is a graph editor for local AI workflows. The project focuses on ease of use and extensibility. The application is a single installer with no external dependencies.
Here are some of the major features in the new release:
- Improved Web Scraping
- Reading Website Feeds
- Automated Browsing Plugins
- Sharing Workflows on the Cloud
- Plugin Examples
- Rewritten UI in Dioxus!
- Package Manger
- Floneum CLI
- Nightly Builds
If you are interested in the project, consider joining the discord, or building a plugin for Floneum in rust using WASI
Download: https://github.com/floneum/floneum/releases/tag/v0.2.0
Join the discord: https://discord.gg/dQdmhuB8q5
Build a plugin: https://floneum.com/docs/developer/index
Feedback is always appreciated!
In Floneum 0.2: Open source, zero dependency, graph editor for local AI workflows1. I would love to support additional model runners including exLlama and API based models like chat GPT. I'm less familiar with how c transformers and GPTQ compare to llama.cpp. GPTQ used to run faster because it supported GPU acceleration, but now llama.cpp supports the GPU as well so that may have changed. Feel free to open a GitHub issue to discuss this: https://github.com/floneum/floneum/issues/new/choose
2. There are a few differences:
a) Floneum doesn't require any setup. No need to install python, cuda, or pop. Just download the executable and run
b) It has first class support for quantized local models
c) It supports fully issolated WASM plugins (not arbitrary python code)
3. Floneum is fully Open Source!
In Show HN: Floneum, a graph editor for local AI workflowsShow HN: Floneum, a graph editor for local AI workflows
Floneum is a graph editor for local AI workflows. The project focuses on ease of use and community made plugins. The application is a single executable with no dependencies you need to install. You can extend Floneum with WASI plugins that run in a environment that is issolated from your system so that you can use untrusted community plugins without worrying about malware. It uses llamma.cpp to run large language models locally, and wasmtime to run issolated plugins.
If you are interested in the project, consider joining the discord, or building a plugin for Floneum in rust using WASI
Download: https://github.com/floneum/floneum/releases/tag/v0.1.0
Join the discord: https://discord.gg/dQdmhuB8q5
Build a plugin: https://floneum.com/docs/developer/index
61 points · Open discussion