MOmodinfo·Jul 13, 2022Submission
2 points · Open discussionconceptofmind
LaMDA-rlhf-pytorch
Python2022–2022
conceptofmind / LaMDA-rlhf-pytorch · Archived
LaMDA-rlhf-pytorch
Open-source pre-training implementation of Google's LaMDA in PyTorch. Adding RLHF similar to ChatGPT.
2Distinct people
2Mentions
0Explicit recommenders
466GitHub stars
What to know before exploring
What it is
Open-source pre-training implementation of Google's LaMDA in PyTorch. Adding RLHF similar to ChatGPT.
GitHub
Where it is used
No documented product use has been verified yet.
What people are saying
No recommendation phrase was found in the indexed comments.
No classified warning is attached to this page. Read the discussions before treating silence as approval.
Also in these discussions
No other repository is repeatedly linked in the same discussions.
This week on Hacker News
Nov 7–Nov 14 UTC · Direct repository links and separately labeled related project stories. Indexed through 11/14/2026, 3:56:07 PM UTC.
No direct repository links were found in the indexed HN discussions over the past seven days. Older discussions are available below.
Mentions over time
HN mentions by day2 dated mentions
Observed mentions: 2022-07-05 17:35:01 UTC to 2022-07-13 17:52:39 UTC.
Counts come from the repository’s dated source evidence. Index cutoff: 2026-11-02 08:16:59 UTC.
View mention counts and date ranges
| Period | Start (UTC) | End (exclusive, UTC) | Mentions | Submissions | Comments |
|---|---|---|---|---|---|
| Jul 5 | 2022-07-05 00:00:00 UTC | 2022-07-06 00:00:00 UTC | 1 | 1 | 0 |
| Jul 6 | 2022-07-06 00:00:00 UTC | 2022-07-07 00:00:00 UTC | 0 | 0 | 0 |
| Jul 7 | 2022-07-07 00:00:00 UTC | 2022-07-08 00:00:00 UTC | 0 | 0 | 0 |
| Jul 8 | 2022-07-08 00:00:00 UTC | 2022-07-09 00:00:00 UTC | 0 | 0 | 0 |
| Jul 9 | 2022-07-09 00:00:00 UTC | 2022-07-10 00:00:00 UTC | 0 | 0 | 0 |
| Jul 10 | 2022-07-10 00:00:00 UTC | 2022-07-11 00:00:00 UTC | 0 | 0 | 0 |
| Jul 11 | 2022-07-11 00:00:00 UTC | 2022-07-12 00:00:00 UTC | 0 | 0 | 0 |
| Jul 12 | 2022-07-12 00:00:00 UTC | 2022-07-13 00:00:00 UTC | 0 | 0 | 0 |
| Jul 13 | 2022-07-13 00:00:00 UTC | 2022-07-14 00:00:00 UTC | 1 | 1 | 0 |
What Hacker News says
2 sourcesAn open-source implementation for the pre-training architecture of Google's LaMDA in PyTorch. The research paper outlines an autoregressive, decoder-only, GPT-like transformer language model. The transformer uses T5 relative positional bias in the attention layers and gated-GELU activation function in the feed-forward layers.
The repository currently contains a script for basic training as well as Huggingface datasets and Weights & Biases integration.
LaMDA research paper: https://arxiv.org/abs/2201.08239
Github repository for the model: https://github.com/conceptofmind/LaMDA-pytorch
The pre-training architecture was peer-reviewed by Dr. Phil Wang. Please check out and support his work: https://github.com/lucidrains.
Updates: https://twitter.com/EnricoShippole
27 points · Open discussion