MOmountainview·Sep 8, 2024Submission
Curated list of LLM models and frameworks for on-device developers
1 points · Open discussionnexaai
awesome-llms-on-device
HISTORICAL RECORD2024–2024
nexaai / awesome-llms-on-device · Not publicly available
awesome-llms-on-device
Discover this repository through its Hacker News conversations.
2Distinct people
2Mentions
0Explicit recommenders
What to know before exploring
What it is
A public description has not been verified.
Where it is used
No documented product use has been verified yet.
What people are saying
No recommendation phrase was found in the indexed comments.
No classified warning is attached to this page. Read the discussions before treating silence as approval.
Also in these discussions
No other repository is repeatedly linked in the same discussions.
This week on Hacker News
Nov 7–Nov 14 UTC · Direct repository links and separately labeled related project stories. Indexed through 11/14/2026, 5:04:57 PM UTC.
No direct repository links were found in the indexed HN discussions over the past seven days. Older discussions are available below.
Mentions over time
HN mentions by 3-hour interval2 dated mentions
Observed mentions: 2024-09-05 12:37:44 UTC to 2024-09-08 12:29:07 UTC.
Counts come from the repository’s dated source evidence. Index cutoff: 2026-11-02 08:16:59 UTC.
View mention counts and date ranges
| Period | Start (UTC) | End (exclusive, UTC) | Mentions | Submissions | Comments |
|---|---|---|---|---|---|
| Sep 5, 12:00 | 2024-09-05 12:00:00 UTC | 2024-09-05 15:00:00 UTC | 1 | 1 | 0 |
| Sep 5, 15:00 | 2024-09-05 15:00:00 UTC | 2024-09-05 18:00:00 UTC | 0 | 0 | 0 |
| Sep 5, 18:00 | 2024-09-05 18:00:00 UTC | 2024-09-05 21:00:00 UTC | 0 | 0 | 0 |
| Sep 5, 21:00 | 2024-09-05 21:00:00 UTC | 2024-09-06 00:00:00 UTC | 0 | 0 | 0 |
| Sep 6, 00:00 | 2024-09-06 00:00:00 UTC | 2024-09-06 03:00:00 UTC | 0 | 0 | 0 |
| Sep 6, 03:00 | 2024-09-06 03:00:00 UTC | 2024-09-06 06:00:00 UTC | 0 | 0 | 0 |
| Sep 6, 06:00 | 2024-09-06 06:00:00 UTC | 2024-09-06 09:00:00 UTC | 0 | 0 | 0 |
| Sep 6, 09:00 | 2024-09-06 09:00:00 UTC | 2024-09-06 12:00:00 UTC | 0 | 0 | 0 |
| Sep 6, 12:00 | 2024-09-06 12:00:00 UTC | 2024-09-06 15:00:00 UTC | 0 | 0 | 0 |
| Sep 6, 15:00 | 2024-09-06 15:00:00 UTC | 2024-09-06 18:00:00 UTC | 0 | 0 | 0 |
| Sep 6, 18:00 | 2024-09-06 18:00:00 UTC | 2024-09-06 21:00:00 UTC | 0 | 0 | 0 |
| Sep 6, 21:00 | 2024-09-06 21:00:00 UTC | 2024-09-07 00:00:00 UTC | 0 | 0 | 0 |
| Sep 7, 00:00 | 2024-09-07 00:00:00 UTC | 2024-09-07 03:00:00 UTC | 0 | 0 | 0 |
| Sep 7, 03:00 | 2024-09-07 03:00:00 UTC | 2024-09-07 06:00:00 UTC | 0 | 0 | 0 |
| Sep 7, 06:00 | 2024-09-07 06:00:00 UTC | 2024-09-07 09:00:00 UTC | 0 | 0 | 0 |
| Sep 7, 09:00 | 2024-09-07 09:00:00 UTC | 2024-09-07 12:00:00 UTC | 0 | 0 | 0 |
| Sep 7, 12:00 | 2024-09-07 12:00:00 UTC | 2024-09-07 15:00:00 UTC | 0 | 0 | 0 |
| Sep 7, 15:00 | 2024-09-07 15:00:00 UTC | 2024-09-07 18:00:00 UTC | 0 | 0 | 0 |
| Sep 7, 18:00 | 2024-09-07 18:00:00 UTC | 2024-09-07 21:00:00 UTC | 0 | 0 | 0 |
| Sep 7, 21:00 | 2024-09-07 21:00:00 UTC | 2024-09-08 00:00:00 UTC | 0 | 0 | 0 |
| Sep 8, 00:00 | 2024-09-08 00:00:00 UTC | 2024-09-08 03:00:00 UTC | 0 | 0 | 0 |
| Sep 8, 03:00 | 2024-09-08 03:00:00 UTC | 2024-09-08 06:00:00 UTC | 0 | 0 | 0 |
| Sep 8, 06:00 | 2024-09-08 06:00:00 UTC | 2024-09-08 09:00:00 UTC | 0 | 0 | 0 |
| Sep 8, 09:00 | 2024-09-08 09:00:00 UTC | 2024-09-08 12:00:00 UTC | 0 | 0 | 0 |
| Sep 8, 12:00 | 2024-09-08 12:00:00 UTC | 2024-09-08 15:00:00 UTC | 1 | 1 | 0 |
What Hacker News says
2 sourcesShow HN: We built a knowledge hub for running LLMs on edge devices
Hey HN! Alex and Zack from Nexa AI here. We are excited to share a project our team has been passionately working on recently, in collaboration with Jiajun from Meta, Qun from San Francisco State University, and Xin and Qi from the University of North Texas.
Running AI models on edge devices is becoming increasingly important. It's cost-effective, ensures privacy, offers low-latency responses, and allows for customization. Plus, it's always available, even offline. What's really exciting is that smaller-scale models are now approaching the performance of large-scale closed-source models for many use cases like "writing assistant" and "email classifier".
We've been immersing ourselves in this rapidly evolving field of on-device AI - from smartphones to IoT gadgets and even that Raspberry Pi you might have lying around. It's a fascinating f
Read the rest
ield that's moving incredibly fast, and honestly, it's been a challenge just keeping up with all the developments.
To help us make sense of it all, we started compiling our notes, findings, and resources into a single place. That turned into this GitHub repo: https://github.com/NexaAI/Awesome-LLMs-on-device
Here's what you'll find inside:
A timeline tracking the evolution of on-device AI models
Our analysis of efficient architectures and optimization techniques (there are some seriously clever tricks out there)
A curated list of cutting-edge models and frameworks we've come across
Real-world examples and case studies that got us excited about the potential of this tech
We're constantly updating it as we learn more. It's become an invaluable resource for our own work, and we hope it can be useful for others too - whether you're deep in the trenches of AI research or just curious about where edge computing is heading.
We'd love to hear what you think. If you spot anything we've missed, have some insights to add, or just want to geek out about on-device AI, please don't hesitate to contribute or reach out. We're all learning together here!
This is a topic we are genuinely passionate about, and we are looking forward to some great discussions. Thanks for checking it out!