AMAmbix·Jun 11, 2023
You might reuse simple LLaMA tokenizer right in your Go code, look there:
https://github.com/gotzmann/llama.go/blob/8cc54ca81e6bfbce25...
In Understanding GPT tokenizersgotzmann
llama.go
Go2023–2023
gotzmann / llama.go
llama.go
llama.go is like llama.cpp in pure Golang!
2Distinct people
7Mentions
0Explicit recommenders
1.4KGitHub stars
What to know before exploring
What it is
llama.go is like llama.cpp in pure Golang!
GitHub
Where it is used
No documented product use has been verified yet.
What people are saying
No recommendation phrase was found in the indexed comments.
No classified warning is attached to this page. Read the discussions before treating silence as approval.
Also in these discussions
No other repository is repeatedly linked in the same discussions.
This week on Hacker News
Nov 7–Nov 14 UTC · Direct repository links and separately labeled related project stories. Indexed through 11/14/2026, 3:56:07 PM UTC.
No direct repository links were found in the indexed HN discussions over the past seven days. Older discussions are available below.
Mentions over time
HN mentions by week7 dated mentions
Observed mentions: 2023-04-12 17:42:39 UTC to 2023-06-11 09:51:13 UTC. Weeks start Monday, UTC.
Counts come from the repository’s dated source evidence. Index cutoff: 2026-11-02 08:16:59 UTC.
View mention counts and date ranges
| Period | Start (UTC) | End (exclusive, UTC) | Mentions | Submissions | Comments |
|---|---|---|---|---|---|
| Apr 10 | 2023-04-10 00:00:00 UTC | 2023-04-17 00:00:00 UTC | 1 | 1 | 0 |
| Apr 17 | 2023-04-17 00:00:00 UTC | 2023-04-24 00:00:00 UTC | 3 | 0 | 3 |
| Apr 24 | 2023-04-24 00:00:00 UTC | 2023-05-01 00:00:00 UTC | 1 | 0 | 1 |
| May 1 | 2023-05-01 00:00:00 UTC | 2023-05-08 00:00:00 UTC | 1 | 0 | 1 |
| May 8 | 2023-05-08 00:00:00 UTC | 2023-05-15 00:00:00 UTC | 0 | 0 | 0 |
| May 15 | 2023-05-15 00:00:00 UTC | 2023-05-22 00:00:00 UTC | 0 | 0 | 0 |
| May 22 | 2023-05-22 00:00:00 UTC | 2023-05-29 00:00:00 UTC | 0 | 0 | 0 |
| May 29 | 2023-05-29 00:00:00 UTC | 2023-06-05 00:00:00 UTC | 0 | 0 | 0 |
| Jun 5 | 2023-06-05 00:00:00 UTC | 2023-06-12 00:00:00 UTC | 1 | 0 | 1 |
What Hacker News says
7 sourcesYeah, it's really so bad on desktops.
With my LLaMA AVX implementation on 32bit floats [0] there no performance gain after 2 threads, so remaining 14 threads available are of no use, there no memory bandwidth to load them with work :)
[0] https://github.com/gotzmann/llama.go
In OpenLLaMA: An Open Reproduction of LLaMALLaMA.go - open-source framework for LLM inference on regular CPUs [0]
It took me about a month of full-time, hard, day and night coding (including weekends) to finally build a solid piece which can handle some crazy CPU workloads of tensor math.
[0] https://github.com/gotzmann/llama.go
In Ask HN: Most interesting tech you built for just yourself?Someone implemented llama on Go recently, https://github.com/gotzmann/llama.go
Wouldn't discard a rust implementation of some LLM architecture at some point
In StableLM: A new open-source language modelNot the TS, but that's actually the same goal I have in mind with [0] project.
Right now I'm building my homelab server which aimed to fit 1 TB RAM and 2 CPUs with ~100 cores total.
It will cost like 0.1% of what I need to pay for GPU cluster with the same memory size :)
[0] https://github.com/gotzmann/llama.go/
In OpenAI’s CEO says the age of giant AI models is already overI'm developing framework [1] in Golang with this goal in mind :) It successfully runs relatively big LLM right now, and diffusion models will be the next step
[1] https://github.com/gotzmann/llama.go/
In MiniGPT-4Show HN: Llama.go – port of llama.cpp to pure Go
It's April 12 - The First Man in Space* Day - and I'm releasing #ML framework I've been building for the last month :)
It's written in #Go and allows #LLaMA #GPT inference having just regular PC - so no monster GPU cluster is needed to start experiment with:
https://github.com/gotzmann/llama.go
The V1 is using FP32 math only, but will work with AVX2 data types and INT8 quantisation soon.
* The first man in space was Yuri Gagarin from USSR
25 points · Open discussion