HackerReposA FIELD GUIDE TO OPEN SOURCE
ProSponsor the shelf♧ 0
← Back to top all-time
mudler
LocalAI
Go2023–2026
mudler / LocalAI

LocalAI

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

29Distinct people
40Mentions
0Explicit recommenders
50.3KGitHub stars
REPOSITORY AT A GLANCE

What to know before exploring

What it is

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

GitHub

Where it is used

No documented product use was verified in the last source check.

What people are saying

No recommendation phrase was found in the indexed comments.

No classified warning is attached to this page. Read the discussions before treating silence as approval.

Also in these discussions

Mentioned in the same Hacker News threads. That is not proof they are substitutes.

This week on Hacker News

Nov 9–Nov 16 UTC · Direct repository links and separately labeled related project stories. Indexed through 11/16/2026, 8:59:02 AM UTC.

No direct repository links were found in the indexed HN discussions over the past seven days. Older discussions are available below.

Mentions over time

HN mentions by year40 dated mentions

Observed mentions: 2023-04-24 16:59:11 UTC to 2026-08-28 22:12:49 UTC.

01020302023-01-01 00:00:00 UTC to 2024-01-01 00:00:00 UTC (exclusive): 31 mentions; 2 submissions, 29 comments20232024-01-01 00:00:00 UTC to 2025-01-01 00:00:00 UTC (exclusive): 7 mentions; 3 submissions, 4 comments20242025-01-01 00:00:00 UTC to 2026-01-01 00:00:00 UTC (exclusive): 1 mentions; 0 submissions, 1 comments2026-01-01 00:00:00 UTC to 2027-01-01 00:00:00 UTC (exclusive): 1 mentions; 1 submissions, 0 comments. Incomplete calendar period.2026*

* An incomplete calendar period is marked with an outlined bar. Its count is not directly comparable with a full period.

Counts come from the repository’s dated source evidence. Index cutoff: 2026-11-02 08:16:59 UTC.

View mention counts and date ranges
UTC ranges include their start and exclude their end. Select a period to filter the source evidence.
PeriodStart (UTC)End (exclusive, UTC)MentionsSubmissionsComments
20232023-01-01 00:00:00 UTC2024-01-01 00:00:00 UTC31229
20242024-01-01 00:00:00 UTC2025-01-01 00:00:00 UTC734
20252025-01-01 00:00:00 UTC2026-01-01 00:00:00 UTC101
2026 (partial)2026-01-01 00:00:00 UTC2027-01-01 00:00:00 UTC110

What Hacker News says

31 sources
Your hardware should be fine for inferencing, as long as you don't bother trying to get the GPU working. My $0.02 would be to try getting LocalAI running on your machine with OpenCL/CLBlas acceleration for your CPU. If you're running other things, you could limit the inferencing process to 2 or 3 threads. That should get it working; I've been able to inference even 13b models on cheap Rockchip SOCs. Your CPU should be fine, even if it's a little outdated. LocalAI: https://github.com/mudler/LocalAI Some decent models to start with: TinyLlama (extremely small/fast): https://huggingface.co/TheBloke/TinyLlama-1.1B-Chat-v0.3-GGU... Dolphin Mistral (larger size, better responses: https://huggingface.co/TheBloke/dolphin-2.1-mistral-7B-GGUF
In Local LLM's to run on old iMac / Hardware
We have a cloud offering at https://trypromptly.com. We do offer enterprises the ability to host their own vector database to maintain control of their data. We also support interacting with open source LLMs from the platform. Enterprises can bring up https://github.com/go-skynet/LocalAI, run Llama or others and connect to them from their Promptly LLM apps. We also provide support and some premium processors for enterprise on-prem deployments.
In ChatGPT Enterprise
Seemed like a great project. Hope to see it come back! There are some great open-source projects in this space – not quite the same – many are focused on local LLMs like Llama2 or Code Llama which was released last week: - https://github.com/jmorganca/ollama (download & run LLMs locally - I'm a maintainer) - https://github.com/simonw/llm (access LLMs from the cli - cloud and local) - https://github.com/oobabooga/text-generation-webui (a web ui w/ different backends) - https://github.com/ggerganov/llama.cpp (fast local LLM runner) - https://github.com/go-skynet/LocalAI (has an openai-compatible api)
In ChatGPT Enterprise
Honestly if you can get yourself a video card with at least 12gb of RAM and I highly recommend running open source models locally. It doesn’t have to be the latest fancy gaming card - I run an old 2016 Tesla P100 ($200AUD~) which is fine for 16B q4 models. They’re more configurable, there’s no subscription model, you contribute to them and meaningful ways, there is a privacy concern if you’re passing your own data and it’s perhaps strangely a more fulfilling experience. I’ve got mine hooked up to Home Assistant so I can automate things with Siri and shortcuts, I’m using it finding patterns and code and several decades of digital notes. If you’re not sure where to start, you can try some models out locally on your machine, using apps like https://lmstudio.ai or GPT4All with almost no ML knowledge. Then if you want to level up and customise
Read the rest
things and run them on the server you can use localAI, Text generation web UI etc which provide openAI compatible APIs. A good 13B model with decent prompting feels pretty on par with chatGPT (3.5) for general tasks, but can be configured to be quite good at very specific things. https://github.com/oobabooga/text-generation-webui https://github.com/go-skynet/LocalAI https://github.com/gitmylo/audio-webui
In ChatGPT costs 700k/day to run; may go bankrupt in 2024

Showing the 15 most recent of 31 sources. Enable JavaScript to search and browse every indexed mention.

MAKE YOURSELF AT HOME

A few shortcuts

/
Search the collection
?
Open this guide
Esc
Close dialogs and navigation

Your saved repositories and interests stay in this browser.