HackerReposA FIELD GUIDE TO OPEN SOURCE
ProSponsor the shelf♧ 0
← Back to top all-time
drumih
turbo-fieldfare
Swift2026–2026
drumih / turbo-fieldfare

turbo-fieldfare

Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

3Distinct people
5Mentions
0Explicit recommenders
7.3KGitHub stars
REPOSITORY AT A GLANCE

What to know before exploring

What it is

Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

GitHub

Where it is used

No documented product use has been verified yet.

What people are saying

No recommendation phrase was found in the indexed comments.

No classified warning is attached to this page. Read the discussions before treating silence as approval.

Also in these discussions

No other repository is repeatedly linked in the same discussions.

This week on Hacker News

Nov 9–Nov 16 UTC · Direct repository links and separately labeled related project stories. Indexed through 11/16/2026, 5:46:40 PM UTC.

No direct repository links were found in the indexed HN discussions over the past seven days. Older discussions are available below.

Mentions over time

HN mentions by day5 dated mentions

Observed mentions: 2026-07-29 15:05:43 UTC to 2026-08-25 21:23:44 UTC.

012026-07-29 00:00:00 UTC to 2026-07-30 00:00:00 UTC (exclusive): 1 mentions; 1 submissions, 0 commentsJul 292026-07-30 00:00:00 UTC to 2026-07-31 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2026-07-31 00:00:00 UTC to 2026-08-01 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2026-08-01 00:00:00 UTC to 2026-08-02 00:00:00 UTC (exclusive): 1 mentions; 0 submissions, 1 comments2026-08-02 00:00:00 UTC to 2026-08-03 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2026-08-03 00:00:00 UTC to 2026-08-04 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2026-08-04 00:00:00 UTC to 2026-08-05 00:00:00 UTC (exclusive): 1 mentions; 0 submissions, 1 comments2026-08-05 00:00:00 UTC to 2026-08-06 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2026-08-06 00:00:00 UTC to 2026-08-07 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2026-08-07 00:00:00 UTC to 2026-08-08 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2026-08-08 00:00:00 UTC to 2026-08-09 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2026-08-09 00:00:00 UTC to 2026-08-10 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2026-08-10 00:00:00 UTC to 2026-08-11 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2026-08-11 00:00:00 UTC to 2026-08-12 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 commentsAug 112026-08-12 00:00:00 UTC to 2026-08-13 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2026-08-13 00:00:00 UTC to 2026-08-14 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2026-08-14 00:00:00 UTC to 2026-08-15 00:00:00 UTC (exclusive): 1 mentions; 0 submissions, 1 comments2026-08-15 00:00:00 UTC to 2026-08-16 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2026-08-16 00:00:00 UTC to 2026-08-17 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2026-08-17 00:00:00 UTC to 2026-08-18 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2026-08-18 00:00:00 UTC to 2026-08-19 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2026-08-19 00:00:00 UTC to 2026-08-20 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2026-08-20 00:00:00 UTC to 2026-08-21 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2026-08-21 00:00:00 UTC to 2026-08-22 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2026-08-22 00:00:00 UTC to 2026-08-23 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2026-08-23 00:00:00 UTC to 2026-08-24 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2026-08-24 00:00:00 UTC to 2026-08-25 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2026-08-25 00:00:00 UTC to 2026-08-26 00:00:00 UTC (exclusive): 1 mentions; 0 submissions, 1 commentsAug 25

Counts come from the repository’s dated source evidence. Index cutoff: 2026-11-02 08:16:59 UTC.

View mention counts and date ranges
UTC ranges include their start and exclude their end. Select a period to filter the source evidence.
PeriodStart (UTC)End (exclusive, UTC)MentionsSubmissionsComments
Jul 292026-07-29 00:00:00 UTC2026-07-30 00:00:00 UTC110
Jul 302026-07-30 00:00:00 UTC2026-07-31 00:00:00 UTC000
Jul 312026-07-31 00:00:00 UTC2026-08-01 00:00:00 UTC000
Aug 12026-08-01 00:00:00 UTC2026-08-02 00:00:00 UTC101
Aug 22026-08-02 00:00:00 UTC2026-08-03 00:00:00 UTC000
Aug 32026-08-03 00:00:00 UTC2026-08-04 00:00:00 UTC000
Aug 42026-08-04 00:00:00 UTC2026-08-05 00:00:00 UTC101
Aug 52026-08-05 00:00:00 UTC2026-08-06 00:00:00 UTC000
Aug 62026-08-06 00:00:00 UTC2026-08-07 00:00:00 UTC000
Aug 72026-08-07 00:00:00 UTC2026-08-08 00:00:00 UTC000
Aug 82026-08-08 00:00:00 UTC2026-08-09 00:00:00 UTC000
Aug 92026-08-09 00:00:00 UTC2026-08-10 00:00:00 UTC000
Aug 102026-08-10 00:00:00 UTC2026-08-11 00:00:00 UTC000
Aug 112026-08-11 00:00:00 UTC2026-08-12 00:00:00 UTC000
Aug 122026-08-12 00:00:00 UTC2026-08-13 00:00:00 UTC000
Aug 132026-08-13 00:00:00 UTC2026-08-14 00:00:00 UTC000
Aug 142026-08-14 00:00:00 UTC2026-08-15 00:00:00 UTC101
Aug 152026-08-15 00:00:00 UTC2026-08-16 00:00:00 UTC000
Aug 162026-08-16 00:00:00 UTC2026-08-17 00:00:00 UTC000
Aug 172026-08-17 00:00:00 UTC2026-08-18 00:00:00 UTC000
Aug 182026-08-18 00:00:00 UTC2026-08-19 00:00:00 UTC000
Aug 192026-08-19 00:00:00 UTC2026-08-20 00:00:00 UTC000
Aug 202026-08-20 00:00:00 UTC2026-08-21 00:00:00 UTC000
Aug 212026-08-21 00:00:00 UTC2026-08-22 00:00:00 UTC000
Aug 222026-08-22 00:00:00 UTC2026-08-23 00:00:00 UTC000
Aug 232026-08-23 00:00:00 UTC2026-08-24 00:00:00 UTC000
Aug 242026-08-24 00:00:00 UTC2026-08-25 00:00:00 UTC000
Aug 252026-08-25 00:00:00 UTC2026-08-26 00:00:00 UTC101

What Hacker News says

1 sources

Show HN: Open-source engine running Gemma 4 26B in 2 GB RAM on any M-series Mac

Hi HN, I built a specialized inference engine for running 4-bit Gemma 4 26B-A4B-IT on any M-series Mac using about 2 GB of RAM. It is called TurboFieldfare and is written in Swift and Metal. I have always adored on-device AI. It feels like magic that you can run a powerful NN on your Mac or iPhone. So I wanted to push the limits a bit and run a model whose weights don’t fit in memory. The model’s 4-bit quantized weights occupy roughly 14 GB, which makes running it with conventional inference tools almost impossible on an 8 GB or even 16 GB Mac once the OS, applications, and KV cache are included. The trick is to keep the shared part of the model and the KV cache in RAM, then stream only the routed experts needed for each token from SSD. An SSD is way slower than RAM, so the runtime uses a small expert cache and bounded parallel `pread`. W
Read the rest
hile those reads are in flight, the GPU runs the shared part of the layer. I ran more than 100 experiments. Most didn’t work. A few got me here. The experiments are described in the GitHub repo. It currently generates 5–6 tok/s on an 8 GB M2 MacBook Air and 31–35 tok/s on an M5 MacBook Pro. I also added an experimental OpenAI-compatible local server. It supports streaming and tool calls, and reuses one prompt prefix from the KV cache. Try it! The Mac app is easy to install. On the first run, it will download 15 GB of weights from Hugging Face. The model is surprisingly capable. I would love any kind of feedback!
919 points · Open discussion

MAKE YOURSELF AT HOME

A few shortcuts

/
Search the collection
?
Open this guide
Esc
Close dialogs and navigation

Your saved repositories and interests stay in this browser.