19-84

redd-archiver

Python2026–2026

19-84 / redd-archiver

redd-archiver

A PostgreSQL-backed archive generator that creates browsable HTML archives from link aggregator platforms including Reddit, Voat, and Ruqqus.

Explore on GitHub Read Hacker News discussions

2Distinct people

8Mentions

0Explicit recommenders

351GitHub stars

REPOSITORY AT A GLANCE

What to know before exploring

What it is

A PostgreSQL-backed archive generator that creates browsable HTML archives from link aggregator platforms including Reddit, Voat, and Ruqqus.

GitHub

Where it is used

No documented product use has been verified yet.

What people are saying

No recommendation phrase was found in the indexed comments.

No classified warning is attached to this page. Read the discussions before treating silence as approval.

Also in these discussions

No other repository is repeatedly linked in the same discussions.

This week on Hacker News

Nov 7–Nov 14 UTC · Direct repository links and separately labeled related project stories. Indexed through 11/14/2026, 3:56:07 PM UTC.

No direct repository links were found in the indexed HN discussions over the past seven days. Older discussions are available below.

Mentions over time

HN mentions by hour8 dated mentions

Observed mentions: 2026-01-13 15:35:09 UTC to 2026-01-13 22:52:39 UTC.

Counts come from the repository’s dated source evidence. Index cutoff: 2026-11-02 08:16:59 UTC.

View mention counts and date ranges

UTC ranges include their start and exclude their end. Select a period to filter the source evidence.
Period	Start (UTC)	End (exclusive, UTC)	Mentions	Submissions	Comments
Jan 13, 15:00	2026-01-13 15:00:00 UTC	2026-01-13 16:00:00 UTC	1	1	0
Jan 13, 16:00	2026-01-13 16:00:00 UTC	2026-01-13 17:00:00 UTC	0	0	0
Jan 13, 17:00	2026-01-13 17:00:00 UTC	2026-01-13 18:00:00 UTC	0	0	0
Jan 13, 18:00	2026-01-13 18:00:00 UTC	2026-01-13 19:00:00 UTC	1	0	1
Jan 13, 19:00	2026-01-13 19:00:00 UTC	2026-01-13 20:00:00 UTC	2	0	2
Jan 13, 20:00	2026-01-13 20:00:00 UTC	2026-01-13 21:00:00 UTC	0	0	0
Jan 13, 21:00	2026-01-13 21:00:00 UTC	2026-01-13 22:00:00 UTC	1	0	1
Jan 13, 22:00	2026-01-13 22:00:00 UTC	2026-01-13 23:00:00 UTC	3	0	3

What Hacker News says

8 sources

19-84·Jan 13, 2026

I included a metadata dump of every subreddit found in the torrent. it includes a status field which will show of a subreddit is private along with a much more details data catalog readme: https://github.com/19-84/redd-archiver/blob/main/tools/READM... reddit data: https://github.com/19-84/redd-archiver/blob/main/tools/subre...

In Show HN: Self-host Reddit – 2.38B posts, works offline, yours forever

19-84·Jan 13, 2026

ive created tooling for an instance registry and team based leaderboard. the API has function to support this as well, so that we can collectively host archives in a decentralized and distributed manner registry readme: https://github.com/19-84/redd-archiver/blob/main/docs/REGIST... register instances: https://github.com/19-84/redd-archiver/blob/main/.github/ISS...

In Show HN: Self-host Reddit – 2.38B posts, works offline, yours forever

19-84·Jan 13, 2026

I've updated the workflow and added a placeholder page that will serve before archives are created. thanks again! https://github.com/19-84/redd-archiver/commit/0dfd505ca81cb2...

In Show HN: Self-host Reddit – 2.38B posts, works offline, yours forever

19-84·Jan 13, 2026

thank you for your comment, some example dot files were not copied in my original repo, they have now been added. https://github.com/19-84/redd-archiver/commit/0bb103952195ae... the docs have been updated with mkdir steps https://github.com/19-84/redd-archiver/commit/c3754ea3a0238f...

In Show HN: Self-host Reddit – 2.38B posts, works offline, yours forever

19-84·Jan 13, 2026

thank you for your comment, I will support any platform that has complete dataset available. I will take submissions for any complete datasets through github issues. https://github.com/19-84/redd-archiver/blob/main/.github/ISS...

In Show HN: Self-host Reddit – 2.38B posts, works offline, yours forever

19-84·Jan 13, 2026

I have also published sub statistics and profiling for each platform. these can be used to help identify which subs to prioritize for archiving. reddit: https://github.com/19-84/redd-archiver/blob/main/tools/subre... voat: https://github.com/19-84/redd-archiver/blob/main/tools/subve... ruqqus: https://github.com/19-84/redd-archiver/blob/main/tools/guild...

In Show HN: Self-host Reddit – 2.38B posts, works offline, yours forever

NickNaraghi·Jan 13, 2026

Data is available via torrent in this section: https://github.com/19-84/redd-archiver?tab=readme-ov-file#-g...

In Show HN: Self-host Reddit – 2.38B posts, works offline, yours forever

19-84·Jan 13, 2026Submission

Show HN: Self-host Reddit – 2.38B posts, works offline, yours forever

Reddit's API is effectively dead for archival. Third-party apps are gone. Reddit has threatened to cut off access to the Pushshift dataset multiple times. But 3.28TB of Reddit history exists as a torrent right now, and I built a tool to turn it into something you can browse on your own hardware. The key point: This doesn't touch Reddit's servers. Ever. Download the Pushshift dataset, run my tool locally, get a fully browsable archive. Works on an air-gapped machine. Works on a Raspberry Pi serving your LAN. Works on a USB drive you hand to someone. What it does: Takes compressed data dumps from Reddit (.zst), Voat (SQL), and Ruqqus (.7z) and generates static HTML. No JavaScript, no external requests, no tracking. Open index.html and browse. Want search? Run the optional Docker stack with PostgreSQL – still entirely on your machine. API &

Read the rest

AI Integration: Full REST API with 30+ endpoints – posts, comments, users, subreddits, full-text search, aggregations. Also ships with an MCP server (29 tools) so you can query your archive directly from AI tools. Self-hosting options: - USB drive / local folder (just open the HTML files) - Home server on your LAN - Tor hidden service (2 commands, no port forwarding needed) - VPS with HTTPS - GitHub Pages for small archives Why this matters: Once you have the data, you own it. No API keys, no rate limits, no ToS changes can take it away. Scale: Tens of millions of posts per instance. PostgreSQL backend keeps memory constant regardless of dataset size. For the full 2.38B post dataset, run multiple instances by topic. How I built it: Python, PostgreSQL, Jinja2 templates, Docker. Used Claude Code throughout as an experiment in AI-assisted development. Learned that the workflow is "trust but verify" – it accelerates the boring parts but you still own the architecture. Live demo: https://online-archives.github.io/redd-archiver-example/ GitHub: https://github.com/19-84/redd-archiver (Public Domain) Pushshift torrent: https://academictorrents.com/details/1614740ac8c94505e4ecb9d...

286 points · Open discussion