GAgardenfelder·May 18, 2023Submission
1 points · Open discussiontogethercomputer
OpenChatKit
Python2023–2023
togethercomputer / OpenChatKit
OpenChatKit
Discover this repository through its Hacker News conversations.
11Distinct people
11Mentions
0Explicit recommenders
9KGitHub stars
What to know before exploring
What it is
A public description has not been verified.
Where it is used
No documented product use has been verified yet.
What people are saying
No recommendation phrase was found in the indexed comments.
No classified warning is attached to this page. Read the discussions before treating silence as approval.
Also in these discussions
No other repository is repeatedly linked in the same discussions.
This week on Hacker News
Nov 7–Nov 14 UTC · Direct repository links and separately labeled related project stories. Indexed through 11/14/2026, 12:24:10 PM UTC.
No direct repository links were found in the indexed HN discussions over the past seven days. Older discussions are available below.
Mentions over time
HN mentions by week11 dated mentions
Observed mentions: 2023-03-12 00:45:03 UTC to 2023-05-18 22:01:45 UTC. Weeks start Monday, UTC.
Counts come from the repository’s dated source evidence. Index cutoff: 2026-11-02 08:16:59 UTC.
View mention counts and date ranges
| Period | Start (UTC) | End (exclusive, UTC) | Mentions | Submissions | Comments |
|---|---|---|---|---|---|
| Mar 6 | 2023-03-06 00:00:00 UTC | 2023-03-13 00:00:00 UTC | 2 | 2 | 0 |
| Mar 13 | 2023-03-13 00:00:00 UTC | 2023-03-20 00:00:00 UTC | 2 | 2 | 0 |
| Mar 20 | 2023-03-20 00:00:00 UTC | 2023-03-27 00:00:00 UTC | 5 | 1 | 4 |
| Mar 27 | 2023-03-27 00:00:00 UTC | 2023-04-03 00:00:00 UTC | 0 | 0 | 0 |
| Apr 3 | 2023-04-03 00:00:00 UTC | 2023-04-10 00:00:00 UTC | 0 | 0 | 0 |
| Apr 10 | 2023-04-10 00:00:00 UTC | 2023-04-17 00:00:00 UTC | 1 | 1 | 0 |
| Apr 17 | 2023-04-17 00:00:00 UTC | 2023-04-24 00:00:00 UTC | 0 | 0 | 0 |
| Apr 24 | 2023-04-24 00:00:00 UTC | 2023-05-01 00:00:00 UTC | 0 | 0 | 0 |
| May 1 | 2023-05-01 00:00:00 UTC | 2023-05-08 00:00:00 UTC | 0 | 0 | 0 |
| May 8 | 2023-05-08 00:00:00 UTC | 2023-05-15 00:00:00 UTC | 0 | 0 | 0 |
| May 15 | 2023-05-15 00:00:00 UTC | 2023-05-22 00:00:00 UTC | 1 | 1 | 0 |
What Hacker News says
11 sourcesOpenChatKit: Open-source kit for setting up a local, libre, LLM chatbot
2 points · Open discussionAnyone know more about their Augmented Models[1] concept?
[1]: https://github.com/togethercomputer/OpenChatKit#experimental...
In OpenChatKit> With no real knowledge of LLM and only recently started to understand what LLM terms mean, such as 'model, inference, LLM model, intruction set, fine tuning' whatelse do you think is required to make a took like yours?
This was mee a few weeks ago. I got interested in all this when FlexGen (https://github.com/FMInference/FlexGen) was announced, which allowed to run inference using OPT model on consumer hardware. I'm an avid user of Stable Diffusion, and I wanted to see if I can have an SD equivalent of ChatGPT.
Not understanding the details of hyperparameters or terminology, I basically asked ChatGPT to explain to me what these things are:
Explain to someone who is a software engineer with limited knowledge of ML terms or linear algebra, what is "feed forward" and "self-attention" in the context of ML and large language models. Provi
Read the rest
de examples when possible.
I did the same with all the other terms I didn't understand, like "ADAM optimizer", "gradient", etc. I relied on it very heavily and cross-referenced the answers.
Looking at other people's code and just tinkering with things on my own really helped.
Through the FlexGen discord I've discovered https://github.com/oobabooga/text-generation-webui where I spent days just playing around with models. This got me into the huggingface ecosystem -- their transformers library is an easy way to get started. I joined a few other discords, like LLaMA Unofficial, RWKV, Eleuther AI, Together, Hivemind and Petals.
I bookmarked a bunch of resources but it's very sporadic. Here are some:
- https://github.com/zphang/minimal-llama/#peft-fine-tuning-wi...
- https://github.com/togethercomputer/OpenChatKit
- https://www.cstroik.com/index.php/2023/02/18/finetuning-an-a...
- https://github.com/huggingface/peft
- https://github.com/kingoflolz/mesh-transformer-jax/blob/mast...
- https://github.com/oobabooga/text-generation-webui
- https://github.com/hizkifw/WebChatRWKVstic
- https://github.com/ggerganov/whisper.cpp
- https://github.com/qwopqwop200/GPTQ-for-LLaMa
- https://github.com/oobabooga/text-generation-webui/issues/14...
- https://github.com/bigscience-workshop/petals
- https://github.com/alpa-projects/alpa
Well, there's the new GPT-Neo models and BLOOM models, and you can spin them up with something like this: https://github.com/togethercomputer/OpenChatKit
In Google releases Bard to a limited number of users in the US and UKFirst models on the block but we have options at least!
https://github.com/togethercomputer/OpenChatKit
https://huggingface.co/OpenAssistant/oasst-sft-1-pythia-12b
In ChatGPT is downOpenChatKit: Open-source, instruction-tuned, 20B parameter language model
4 points · Open discussionOpenChatKit: Base to create both specialized and general purpose chatbots
3 points · Open discussion