DAdanboarder·Mar 21, 2025Submission
Siri Llama – access locally running LLMs through Siri
2 points · Open discussion0ssamaak0
SiriLLama
Python2024–2025
0ssamaak0 / SiriLLama
SiriLLama
Use locally running LLMs directly from Siri 🦙🟣
2Distinct people
2Mentions
0Explicit recommenders
188GitHub stars
What to know before exploring
What it is
Use locally running LLMs directly from Siri 🦙🟣
GitHub
Where it is used
No documented product use has been verified yet.
What people are saying
No recommendation phrase was found in the indexed comments.
No classified warning is attached to this page. Read the discussions before treating silence as approval.
Also in these discussions
No other repository is repeatedly linked in the same discussions.
This week on Hacker News
Nov 7–Nov 14 UTC · Direct repository links and separately labeled related project stories. Indexed through 11/14/2026, 5:04:57 PM UTC.
No direct repository links were found in the indexed HN discussions over the past seven days. Older discussions are available below.
Mentions over time
HN mentions by week2 dated mentions
Observed mentions: 2024-09-21 18:48:47 UTC to 2025-03-21 17:54:31 UTC. Weeks start Monday, UTC.
Counts come from the repository’s dated source evidence. Index cutoff: 2026-11-02 08:16:59 UTC.
View mention counts and date ranges
| Period | Start (UTC) | End (exclusive, UTC) | Mentions | Submissions | Comments |
|---|---|---|---|---|---|
| Sep 16 | 2024-09-16 00:00:00 UTC | 2024-09-23 00:00:00 UTC | 1 | 0 | 1 |
| Sep 23 | 2024-09-23 00:00:00 UTC | 2024-09-30 00:00:00 UTC | 0 | 0 | 0 |
| Sep 30 | 2024-09-30 00:00:00 UTC | 2024-10-07 00:00:00 UTC | 0 | 0 | 0 |
| Oct 7 | 2024-10-07 00:00:00 UTC | 2024-10-14 00:00:00 UTC | 0 | 0 | 0 |
| Oct 14 | 2024-10-14 00:00:00 UTC | 2024-10-21 00:00:00 UTC | 0 | 0 | 0 |
| Oct 21 | 2024-10-21 00:00:00 UTC | 2024-10-28 00:00:00 UTC | 0 | 0 | 0 |
| Oct 28 | 2024-10-28 00:00:00 UTC | 2024-11-04 00:00:00 UTC | 0 | 0 | 0 |
| Nov 4 | 2024-11-04 00:00:00 UTC | 2024-11-11 00:00:00 UTC | 0 | 0 | 0 |
| Nov 11 | 2024-11-11 00:00:00 UTC | 2024-11-18 00:00:00 UTC | 0 | 0 | 0 |
| Nov 18 | 2024-11-18 00:00:00 UTC | 2024-11-25 00:00:00 UTC | 0 | 0 | 0 |
| Nov 25 | 2024-11-25 00:00:00 UTC | 2024-12-02 00:00:00 UTC | 0 | 0 | 0 |
| Dec 2 | 2024-12-02 00:00:00 UTC | 2024-12-09 00:00:00 UTC | 0 | 0 | 0 |
| Dec 9 | 2024-12-09 00:00:00 UTC | 2024-12-16 00:00:00 UTC | 0 | 0 | 0 |
| Dec 16 | 2024-12-16 00:00:00 UTC | 2024-12-23 00:00:00 UTC | 0 | 0 | 0 |
| Dec 23 | 2024-12-23 00:00:00 UTC | 2024-12-30 00:00:00 UTC | 0 | 0 | 0 |
| Dec 30 | 2024-12-30 00:00:00 UTC | 2025-01-06 00:00:00 UTC | 0 | 0 | 0 |
| Jan 6 | 2025-01-06 00:00:00 UTC | 2025-01-13 00:00:00 UTC | 0 | 0 | 0 |
| Jan 13 | 2025-01-13 00:00:00 UTC | 2025-01-20 00:00:00 UTC | 0 | 0 | 0 |
| Jan 20 | 2025-01-20 00:00:00 UTC | 2025-01-27 00:00:00 UTC | 0 | 0 | 0 |
| Jan 27 | 2025-01-27 00:00:00 UTC | 2025-02-03 00:00:00 UTC | 0 | 0 | 0 |
| Feb 3 | 2025-02-03 00:00:00 UTC | 2025-02-10 00:00:00 UTC | 0 | 0 | 0 |
| Feb 10 | 2025-02-10 00:00:00 UTC | 2025-02-17 00:00:00 UTC | 0 | 0 | 0 |
| Feb 17 | 2025-02-17 00:00:00 UTC | 2025-02-24 00:00:00 UTC | 0 | 0 | 0 |
| Feb 24 | 2025-02-24 00:00:00 UTC | 2025-03-03 00:00:00 UTC | 0 | 0 | 0 |
| Mar 3 | 2025-03-03 00:00:00 UTC | 2025-03-10 00:00:00 UTC | 0 | 0 | 0 |
| Mar 10 | 2025-03-10 00:00:00 UTC | 2025-03-17 00:00:00 UTC | 0 | 0 | 0 |
| Mar 17 | 2025-03-17 00:00:00 UTC | 2025-03-24 00:00:00 UTC | 1 | 1 | 0 |
What Hacker News says
2 sourcesEdit: I just found this. I'll give it a try today: https://github.com/0ssamaak0/SiriLLama
---
Open WebUI has a voice chat but the voices are not great. I'm sure they'd love a PR that integrates StyleTTS2.
You can give it a Serper API Key and it will search the web to use as context. It connects to ollama running on a linux box with a $300 RTX 3060 with 12GB of VRAM. The 4bit quant of Llama 3.1 8B takes up a bit more than 6GB of VRAM which means it can run embedding models and STT on the card at the same time.
12GB is the minimum I'd recommend for running quantized models. The RTX 4070 Ti Super is 3x the cost but 7 times "faster" on matmuls.
The AMD cards do inference OK but they are a constant source of frustration when trying to do anything else. I bought one and tried for 3 months before selling it. It's not worth the effort.
I don't ha
Read the rest
ve any interest in allowing it to run shortcuts. Open WebUI has pipelines for integrating function calling. HomeAssistant has some integrations if that's the kind of thing you are thinking about.