AMAMICABoard·Jan 16, 2025Submission
6 points · Open discussiontrholding
llama2.c
C2023–2025
trholding / llama2.c
llama2.c
Llama 2 Everywhere (L2E)
3Distinct people
24Mentions
0Explicit recommenders
1.5KGitHub stars
What to know before exploring
What it is
Llama 2 Everywhere (L2E)
GitHub
Where it is used
No documented product use has been verified yet.
What people are saying
No recommendation phrase was found in the indexed comments.
No classified warning is attached to this page. Read the discussions before treating silence as approval.
Also in these discussions
No other repository is repeatedly linked in the same discussions.
This week on Hacker News
Nov 7–Nov 14 UTC · Direct repository links and separately labeled related project stories. Indexed through 11/14/2026, 3:56:07 PM UTC.
No direct repository links were found in the indexed HN discussions over the past seven days. Older discussions are available below.
Mentions over time
HN mentions by month24 dated mentions
Observed mentions: 2023-08-26 05:28:21 UTC to 2025-01-16 11:04:05 UTC.
Counts come from the repository’s dated source evidence. Index cutoff: 2026-11-02 08:16:59 UTC.
View mention counts and date ranges
| Period | Start (UTC) | End (exclusive, UTC) | Mentions | Submissions | Comments |
|---|---|---|---|---|---|
| Aug 2023 | 2023-08-01 00:00:00 UTC | 2023-09-01 00:00:00 UTC | 3 | 1 | 2 |
| Sep 2023 | 2023-09-01 00:00:00 UTC | 2023-10-01 00:00:00 UTC | 0 | 0 | 0 |
| Oct 2023 | 2023-10-01 00:00:00 UTC | 2023-11-01 00:00:00 UTC | 10 | 5 | 5 |
| Nov 2023 | 2023-11-01 00:00:00 UTC | 2023-12-01 00:00:00 UTC | 1 | 0 | 1 |
| Dec 2023 | 2023-12-01 00:00:00 UTC | 2024-01-01 00:00:00 UTC | 1 | 0 | 1 |
| Jan 2024 | 2024-01-01 00:00:00 UTC | 2024-02-01 00:00:00 UTC | 0 | 0 | 0 |
| Feb 2024 | 2024-02-01 00:00:00 UTC | 2024-03-01 00:00:00 UTC | 0 | 0 | 0 |
| Mar 2024 | 2024-03-01 00:00:00 UTC | 2024-04-01 00:00:00 UTC | 1 | 0 | 1 |
| Apr 2024 | 2024-04-01 00:00:00 UTC | 2024-05-01 00:00:00 UTC | 0 | 0 | 0 |
| May 2024 | 2024-05-01 00:00:00 UTC | 2024-06-01 00:00:00 UTC | 0 | 0 | 0 |
| Jun 2024 | 2024-06-01 00:00:00 UTC | 2024-07-01 00:00:00 UTC | 0 | 0 | 0 |
| Jul 2024 | 2024-07-01 00:00:00 UTC | 2024-08-01 00:00:00 UTC | 5 | 2 | 3 |
| Aug 2024 | 2024-08-01 00:00:00 UTC | 2024-09-01 00:00:00 UTC | 0 | 0 | 0 |
| Sep 2024 | 2024-09-01 00:00:00 UTC | 2024-10-01 00:00:00 UTC | 0 | 0 | 0 |
| Oct 2024 | 2024-10-01 00:00:00 UTC | 2024-11-01 00:00:00 UTC | 0 | 0 | 0 |
| Nov 2024 | 2024-11-01 00:00:00 UTC | 2024-12-01 00:00:00 UTC | 0 | 0 | 0 |
| Dec 2024 | 2024-12-01 00:00:00 UTC | 2025-01-01 00:00:00 UTC | 0 | 0 | 0 |
| Jan 2025 | 2025-01-01 00:00:00 UTC | 2025-02-01 00:00:00 UTC | 3 | 2 | 1 |
What Hacker News says
24 sourcesL2E llama2.c running in a PDF in a Shroedinger PNG [pdf]
6 points · Open discussionL2E Llama2.c in a PDF in a Shroedinger PNG
Visit: https://github.com/trholding/llama2.c
Download the header image from my repo, which is a Polyglot PNG (both a PNG and a PDF). Rename the extension from .png to .pdf and open it in Firefox to run llama2.c inside the PDF! Note that this doesn't work in Chrome.
The PDF contains a version of Karpathy's llama2.c running the tiny 260k model. For more details, check: https://twitter.com/VulcanIgnis/status/1879649889178837025.Y... can find the image here: https://github.com/trholding/llama2.c/blob/master/assets/l2e....
Pure PDF versions of the smaller and smol models are compatible with both Chrome and Firefox, but Adobe Acrobat is not yet supported. I created the PDF part back in November, planning to turn it into a self-regenerating comic demo and add Acrobat support. If Adobe doesn't update the
Read the rest
ir JS engine or improve documentation, I might fork my own reader with WASM for better performance and AI capabilities in PDFs.
Emscripten was used to compile this to something between ASM.JS and JS. Enjoy experimenting with this, though remember it's a tiny 260k model, not super intelligent.
I am passionate about PDFs and frustrated with Adobe's JS engine, which isn't true JS 1.3. This project represents running LLMs inside documents, turning documents into LLM OS. If Adobe doesn't fix JS in PDF, I'm motivated to enhance PDF capabilities myself. This is not the thermodynamic god, just pee/acc where we accelerate peedf :)
My bad, I directly linked to the C file instead of the project here:
It is a program that given a model file, tokenizer file and a prompt, it continues to generate text.
To get it to work, you need to clone and build this: https://github.com/trholding/llama2.c
So the steps are like this:
First you'll need to obtain approval from Meta to download llama3 models on hugging face.
Go to https://huggingface.co/meta-llama/Meta-Llama-3.1-8B-Instruct, fill the form and then go to https://huggingface.co/settings/gated-repos see acceptance status. Once accepted, do the following to download model, export and run.
huggingface-cli download meta-llama/Meta-Llama-3.1-8B-Instruct --include "original/*" --local-dir Meta-Llama-3.1-8B-Instruct
git clone https://github.com/trholding/llama2.c.git
cd llama2.c/
# Export Quantized 8bit
python3 export.py ../llama
Read the rest
3.1_8b_instruct_q8.bin --version 2 --meta-llama ../Meta-Llama-3.1-8B-Instruct/original/
# Fastest Quantized Inference build
make runq_cc_openmp
# Test Llama 3.1 inference, it should generate sensible text
./run ../llama3.1_8b_instruct_q8.bin -z tokenizer_l3.bin -l 3 -i " My cat"
Oh this is super cool! I think maybe the new RoPE scaling method Llama 3.1 uses isn't yet added in? It's some weird one time scaling mechanism found by a grid search to enable 128K context. Essentially the model was trained on 15.6T tokens on 8K context, then iteratively extended to 128K context with 800B tokens.
Can open a PR if people want :) [Edit: Just opened a PR! Apologies my C is very rusty! https://github.com/trholding/llama2.c/pull/14]
https://github.com/trholding/llama2.c/blob/master/runq.c#L65... needs to be scaled with some weird formula like in https://github.com/unslothai/unsloth/blob/main/unsloth/model...
In Llama 3.1 in COkay if anyone wants to try Llama 3.1 inference on CPU, try this: https://github.com/trholding/llama2.c (L2E)
It's a bit buggy but it is fun.
Disclaimer: I am the author of L2E
In Open source AI is the path forwardSingle C file Llama 3.1 Support in Llama 2 Everywhere
1 points · Open discussionNice article. We did a demo for booting to LLM and also as Kernel Module: https://github.com/trholding/llama2.c The whole things was funny and buggy, but since then we have been developing in stealth, even trying to raise VC capital. Our goal is to make computers like a buddy to whom you can talk to and explain things and get work done, kinda like a Jarvis. The way we interact with computers haven't changed for decades, its time to disrupt that to get more productivity. I also believe with this approach one can avoid installing different applications, when the computer (models) emulate activities done through applications. For example, cutting and pasting a dog from a dog photo onto a banner for a dog racing competition would not require you to be a graphics artist nor use tools like photshop / gimp. You could tell the computer and it wou
Read the rest
ld use segment anything to cut the dog, use Text and SD for banner text and bg paste the dog, seek your approval, search for the fastest, best and cheapest banner printing service and submit it. 10 years ago this could have been sci-fi, but now it is a possibility. Just need to connect the dots, package and polish it to make it a good product.
We are trying to create a proper OS that boots to an LLM. A toy demo is available in the releases: https://github.com/trholding/llama2.c
Can we apply?
In The Second Batch of the Open Source AI GrantsYes they do!
https://github.com/jart/cosmopolitan/tree/master/third_party...
and
https://github.com/trholding/llama2.c
In Cosmopolitan Third EditionYou are right. Clearer instructions will be added.
This v0.1 and consider it alpha. A lot of stuff is broken.
The current build just needs 512MB RAM and an x86_64 CPU.
The ISO can be downloaded from the releases here:https://github.com/trholding/llama2.c/releases/tag/L2E_OS_v0...
Currently it doesn't do much useful stuff except for stories.
You could etch the ISO to pendrive and boot on real system or you could run it in qemu/VM too:
qemu-system-x86_64 -display gtk,zoom-to-fit=off -m 512 -accel kvm -vga virtio -cdrom l2eos.iso
There is a known issue that for some it does not work on Virtual Box. All that will be fixed in future versions.
There are also easter eggs and a hidden game of DOOM (Freedom)
Pics: https://twitter.com/VulcanIgnis/status/1708851772435968017
https://www.reddit.com/r/LocalLLaMA/comments/16zklam/i_creat...
User posted
Read the rest
Video of Doom Play: https://www.reddit.com/user/multiverse_fan/comments/170orkz/...
Llama 2 Everywhere (L2E): Standalone, Binary Portable, Bootable Llama 2
320 points · Open discussionPlay a hidden framebuffer Doom on TempleDOS
1 points · Open discussionI feel you!
Here it is: https://github.com/trholding/llama2.c#new---l2e-os-linux-ker...
In A Linux OS that boots to LLAMA2 and has a startrek like UIShowing the 15 most recent of 24 sources. Enable JavaScript to search and browse every indexed mention.