MOmodinfo·Aug 28, 2026Submission
LocalAI – Run any model – LLMs, vision, voice, image, video – on any hardware
2 points · Open discussionmudler
LocalAI
Go2023–2026
mudler / LocalAI
LocalAI
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
29Distinct people
40Mentions
0Explicit recommenders
50.3KGitHub stars
What to know before exploring
What it is
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
GitHub
Where it is used
No documented product use was verified in the last source check.
What people are saying
No recommendation phrase was found in the indexed comments.
No classified warning is attached to this page. Read the discussions before treating silence as approval.
Also in these discussions
- oobabooga/textgen · linked in 3 of the same discussions
- ianarawjo/chainforge · linked in 2 of the same discussions
- ollama/ollama · linked in 2 of the same discussions
Mentioned in the same Hacker News threads. That is not proof they are substitutes.
This week on Hacker News
Nov 7–Nov 14 UTC · Direct repository links and separately labeled related project stories. Indexed through 11/14/2026, 3:56:07 PM UTC.
No direct repository links were found in the indexed HN discussions over the past seven days. Older discussions are available below.
Mentions over time
HN mentions by year40 dated mentions
Observed mentions: 2023-04-24 16:59:11 UTC to 2026-08-28 22:12:49 UTC.
* An incomplete calendar period is marked with an outlined bar. Its count is not directly comparable with a full period.
Counts come from the repository’s dated source evidence. Index cutoff: 2026-11-02 08:16:59 UTC.
View mention counts and date ranges
| Period | Start (UTC) | End (exclusive, UTC) | Mentions | Submissions | Comments |
|---|---|---|---|---|---|
| 2023 | 2023-01-01 00:00:00 UTC | 2024-01-01 00:00:00 UTC | 31 | 2 | 29 |
| 2024 | 2024-01-01 00:00:00 UTC | 2025-01-01 00:00:00 UTC | 7 | 3 | 4 |
| 2025 | 2025-01-01 00:00:00 UTC | 2026-01-01 00:00:00 UTC | 1 | 0 | 1 |
| 2026 (partial) | 2026-01-01 00:00:00 UTC | 2027-01-01 00:00:00 UTC | 1 | 1 | 0 |
What Hacker News says
40 sourcesAs others have already pointed out if you're going to run Ollama in Windows anyway, why not use the native build? And if you want to use WSL, then I'd suggest using something like LocalAI which gives you a lot more control and support for additional formats (GGML, GGUF, GPTQ, ONNX, etc).
https://github.com/mudler/LocalAI
In Nvidia on NixOS WSL – Ollama up 24/7 on your gaming PCbraintrust-proxy: https://github.com/braintrustdata/braintrust-proxy
LocalAI: https://github.com/mudler/LocalAI
E.g promptfoo and chainforge have multi-LLM workflows.
Promptfoo has a YAML configuration for prompts, providers,:
https://www.promptfoo.dev/docs/configuration/guide/
What is the system prompt, and how does a system prompt also bias an analysis?
/? "system prompt"
https://hn.algolia.com/?dateRange=all&page=0&prefix=false&qu...
In Show HN: Adding Mistral Codestral and GPT-4o to Jupyter Notebooks"WebNN: Web Neural Network API"
https://news.ycombinator.com/item?id=36158663 :
> - Src: https://github.com/webmachinelearning/webnn
W3C Candidate Recommendation Draft:
> - Spec: https://www.w3.org/TR/webnn/
> WebNN API: https://www.w3.org/TR/webnn/#api :
>> 7.1. The `navigator.ml` interface
>> webnn-polyfill
E.g. Promptfoo, ChainForge, and LocalAI all have abstractions over many models; also re: Google Desktop and GNU Tracker and NVIDIA's pdfgpt: https://news.ycombinator.com/item?id=39363115
promptfoo:
https://github.com/promptfoo/promptfoo
ChainForge: https://github.com/ianarawjo/ChainForge
LocalAI: https://github.com/go-skynet/LocalAI
In Chrome is adding `window.ai` – a Gemini Nano AI model right inside the browserLocalAI: Self-hosted OpenAI alternative reaches 2.14.0
6 points · Open discussionIf your ultimate goal is privacy, then you should only be looking at open source chat UI front ends:
https://github.com/mckaywrigley/chatbot-ui
https://github.com/oobabooga/text-generation-webui
https://github.com/mudler/LocalAI
And then connecting them to off-line models servers:
- Ollama
- llama.cpp
And you should avoid closed source frontends:
- Recurse
- LM Studio
And closed source models
- ChatGPT
- Gemini
In Show HN: I made an app to use local AI as daily driverDrop-In Replacement for ChatGPT API
2 points · Open discussionPlease check out the following projects:
https://github.com/jmorganca/ollama
https://github.com/mudler/LocalAI
In Ask HN: Set Up Local LLMLocalAI can do that: https://github.com/mudler/LocalAI
https://localai.io/features/openai-functions/
In Swap OpenAI with any open-source modelHow does this compare to LocalAI? https://github.com/mudler/LocalAI
In AI Proxy to swap in any LLM while using OpenAI's SDKYour hardware should be fine for inferencing, as long as you don't bother trying to get the GPU working.
My $0.02 would be to try getting LocalAI running on your machine with OpenCL/CLBlas acceleration for your CPU. If you're running other things, you could limit the inferencing process to 2 or 3 threads. That should get it working; I've been able to inference even 13b models on cheap Rockchip SOCs. Your CPU should be fine, even if it's a little outdated.
LocalAI: https://github.com/mudler/LocalAI
Some decent models to start with:
TinyLlama (extremely small/fast): https://huggingface.co/TheBloke/TinyLlama-1.1B-Chat-v0.3-GGU...
Dolphin Mistral (larger size, better responses: https://huggingface.co/TheBloke/dolphin-2.1-mistral-7B-GGUF
In Local LLM's to run on old iMac / HardwareNeither of this really requires OpenAI. You can do it with locally-running models via something like https://github.com/mudler/LocalAI
In Retrieval Augmented Generation in GoAt the moment only those that support the OpenAI Chat API, with function calling for the structured outputs. For example you can use LocalAI[0][1] to run models locally.
[0] https://github.com/go-skynet/LocalAI
[1] https://localai.io/features/openai-functions/
In Show HN: Magentic – Use LLMs as simple Python functionsShowing the 15 most recent of 40 sources. Enable JavaScript to search and browse every indexed mention.