HackerReposA FIELD GUIDE TO OPEN SOURCE
ProSponsor the shelf♧ 0
← Back to top all-time
thomasantony
llamacpp-python
C++2023–2023
thomasantony / llamacpp-python

llamacpp-python

Python bindings for llama.cpp

2Distinct people
2Mentions
0Explicit recommenders
199GitHub stars
REPOSITORY AT A GLANCE

What to know before exploring

What it is

Python bindings for llama.cpp

GitHub

Where it is used

No documented product use has been verified yet.

What people are saying

No recommendation phrase was found in the indexed comments.

No classified warning is attached to this page. Read the discussions before treating silence as approval.

Also in these discussions

No other repository is repeatedly linked in the same discussions.

This week on Hacker News

Nov 7–Nov 14 UTC · Direct repository links and separately labeled related project stories. Indexed through 11/14/2026, 1:49:46 PM UTC.

No direct repository links were found in the indexed HN discussions over the past seven days. Older discussions are available below.

Mentions over time

HN mentions by day2 dated mentions

Observed mentions: 2023-03-19 02:17:06 UTC to 2023-04-04 15:28:35 UTC.

012023-03-19 00:00:00 UTC to 2023-03-20 00:00:00 UTC (exclusive): 1 mentions; 1 submissions, 0 commentsMar 192023-03-20 00:00:00 UTC to 2023-03-21 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2023-03-21 00:00:00 UTC to 2023-03-22 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2023-03-22 00:00:00 UTC to 2023-03-23 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2023-03-23 00:00:00 UTC to 2023-03-24 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2023-03-24 00:00:00 UTC to 2023-03-25 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2023-03-25 00:00:00 UTC to 2023-03-26 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2023-03-26 00:00:00 UTC to 2023-03-27 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2023-03-27 00:00:00 UTC to 2023-03-28 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 commentsMar 272023-03-28 00:00:00 UTC to 2023-03-29 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2023-03-29 00:00:00 UTC to 2023-03-30 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2023-03-30 00:00:00 UTC to 2023-03-31 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2023-03-31 00:00:00 UTC to 2023-04-01 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2023-04-01 00:00:00 UTC to 2023-04-02 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2023-04-02 00:00:00 UTC to 2023-04-03 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2023-04-03 00:00:00 UTC to 2023-04-04 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2023-04-04 00:00:00 UTC to 2023-04-05 00:00:00 UTC (exclusive): 1 mentions; 0 submissions, 1 commentsApr 4

Counts come from the repository’s dated source evidence. Index cutoff: 2026-11-02 08:16:59 UTC.

View mention counts and date ranges
UTC ranges include their start and exclude their end. Select a period to filter the source evidence.
PeriodStart (UTC)End (exclusive, UTC)MentionsSubmissionsComments
Mar 192023-03-19 00:00:00 UTC2023-03-20 00:00:00 UTC110
Mar 202023-03-20 00:00:00 UTC2023-03-21 00:00:00 UTC000
Mar 212023-03-21 00:00:00 UTC2023-03-22 00:00:00 UTC000
Mar 222023-03-22 00:00:00 UTC2023-03-23 00:00:00 UTC000
Mar 232023-03-23 00:00:00 UTC2023-03-24 00:00:00 UTC000
Mar 242023-03-24 00:00:00 UTC2023-03-25 00:00:00 UTC000
Mar 252023-03-25 00:00:00 UTC2023-03-26 00:00:00 UTC000
Mar 262023-03-26 00:00:00 UTC2023-03-27 00:00:00 UTC000
Mar 272023-03-27 00:00:00 UTC2023-03-28 00:00:00 UTC000
Mar 282023-03-28 00:00:00 UTC2023-03-29 00:00:00 UTC000
Mar 292023-03-29 00:00:00 UTC2023-03-30 00:00:00 UTC000
Mar 302023-03-30 00:00:00 UTC2023-03-31 00:00:00 UTC000
Mar 312023-03-31 00:00:00 UTC2023-04-01 00:00:00 UTC000
Apr 12023-04-01 00:00:00 UTC2023-04-02 00:00:00 UTC000
Apr 22023-04-02 00:00:00 UTC2023-04-03 00:00:00 UTC000
Apr 32023-04-03 00:00:00 UTC2023-04-04 00:00:00 UTC000
Apr 42023-04-04 00:00:00 UTC2023-04-05 00:00:00 UTC101

What Hacker News says

2 sources
tantony·Mar 19, 2023Submission

Show HN: Python Bindings for llama.cpp with some CLIs

These are my Python bindings for @ggerganov's llama.cpp. My Python bindings build on this work and provide an easy-to-use interface for Python developers to take advantage of LlamaCPP's powerful inference capabilities. The bindings currently use code from a pending PR of mine to make the original code into more of a library. Hopefully it will get merged into the main repository soon. I have also added a few CLI entry points that get installed along with the python package: * llamacpp-convert - convert pytorch models into GGML format. This is an alias for the existing Python script in llama.cpp and requires PyTorch * llamacpp-quantize - Perform INT4 quantization on the GGML mode. This is a wrapper for the "quantize" C++ program from the original repository and has no dependencies. * llamacpp-cli - This is a Python version of the "main.cpp"
Read the rest
program from the original repository that utilizes the bindings. * llamacpp-chat - A wrapper over llamacpp-cli that includes a prompt that makes it behave like a chatbot. This is not very good as of right now. You should theoretically be able to do "pip install llamacpp" and get going on most linux/macOS platforms by just running `llamacpp-cli`. I do not have Windows builds on the CI yet and you may have to build it yourself. The package has no dependencies if you just want to run inference on the models.
2 points · Open discussion

MAKE YOURSELF AT HOME

A few shortcuts

/
Search the collection
?
Open this guide
Esc
Close dialogs and navigation

Your saved repositories and interests stay in this browser.