The Apple Support Community is being shut down due to its long-standing reputation for providing inaccurate, unhelpful, and toxic responses rather than genuine technical support. Users criticize the platform for polluting search results with misinformation and serving as a venue for community members to harass or dismiss users instead of solving problems.
234 readable replies · Supporting reply 1 · Supporting reply 2 · Supporting reply 3 · Supporting reply 4ArchiveTeam
grab-site
Python2016–2026
ArchiveTeam / grab-site
grab-site
The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns
9Distinct people
22Mentions
0Explicit recommenders
1.6KGitHub stars
What to know before exploring
What it is
The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns
GitHub
Where it is used
No documented product use was verified in the last source check.
What people are saying
No recommendation phrase was found in the indexed comments.
No classified warning is attached to this page. Read the discussions before treating silence as approval.
Also in these discussions
No other repository is repeatedly linked in the same discussions.
This week on Hacker News
Nov 7–Nov 14 UTC · Direct repository links and separately labeled related project stories. Indexed through 11/14/2026, 5:04:57 PM UTC.
Mentions over time
HN mentions by year22 dated mentions
Observed mentions: 2016-02-08 10:51:40 UTC to 2026-07-06 18:23:08 UTC.
* An incomplete calendar period is marked with an outlined bar. Its count is not directly comparable with a full period.
Counts come from the repository’s dated source evidence. Index cutoff: 2026-11-02 08:16:59 UTC.
View mention counts and date ranges
| Period | Start (UTC) | End (exclusive, UTC) | Mentions | Submissions | Comments |
|---|---|---|---|---|---|
| 2016 | 2016-01-01 00:00:00 UTC | 2017-01-01 00:00:00 UTC | 2 | 0 | 2 |
| 2017 | 2017-01-01 00:00:00 UTC | 2018-01-01 00:00:00 UTC | 0 | 0 | 0 |
| 2018 | 2018-01-01 00:00:00 UTC | 2019-01-01 00:00:00 UTC | 2 | 0 | 2 |
| 2019 | 2019-01-01 00:00:00 UTC | 2020-01-01 00:00:00 UTC | 4 | 0 | 4 |
| 2020 | 2020-01-01 00:00:00 UTC | 2021-01-01 00:00:00 UTC | 2 | 0 | 2 |
| 2021 | 2021-01-01 00:00:00 UTC | 2022-01-01 00:00:00 UTC | 0 | 0 | 0 |
| 2022 | 2022-01-01 00:00:00 UTC | 2023-01-01 00:00:00 UTC | 2 | 0 | 2 |
| 2023 | 2023-01-01 00:00:00 UTC | 2024-01-01 00:00:00 UTC | 1 | 0 | 1 |
| 2024 | 2024-01-01 00:00:00 UTC | 2025-01-01 00:00:00 UTC | 6 | 0 | 6 |
| 2025 | 2025-01-01 00:00:00 UTC | 2026-01-01 00:00:00 UTC | 1 | 0 | 1 |
| 2026 (partial) | 2026-01-01 00:00:00 UTC | 2027-01-01 00:00:00 UTC | 2 | 0 | 2 |
What Hacker News says
22 sourcesTOtoomuchtodo·Jul 6, 2026
Great docs. If you want to create WARC files for archival purposes [1], wget supports doing so natively [2]. grab-site automates this [3].
[1] https://en.wikipedia.org/wiki/WARC_(file_format)
[2] https://wiki.archiveteam.org/index.php/Wget_with_WARC_output
[3] https://github.com/ArchiveTeam/grab-site
In Speedcube.de forum archive using wget and squashfshttps://github.com/archiveteam/grab-site or browsertrix may be easier to use for some, it's what was used to save a lot of the data.gov stuff before it got taken down.
In Show HN: Kage – Shadow any website to a single binary for offline viewingA cool feature would be to be able to read WARC files from crawling the target site previously.
https://github.com/webrecorder/warcio
https://github.com/ArchiveTeam/grab-site
In Show HN: Got Tired of LLMs refusing to visit URLs Built open source analyzer CLIhttps://github.com/ArchiveTeam/grab-site might be helpful. I'm a fan of the ability to create WARC archives from a target, uploard the WARC files to object storage (whether that is IA, S3, Backblaze B2, etc), and then keep them in cold storage or serve them up via HTTPS or a torrent (mutable, preferred). The Internet Archive serves a torrent file for every item they host; one can do the same with WARC archives to enable a distributed archive. CDX indexes can be used for rapidly querying the underlying WARC archives.
You might support cryptographically signing WARC archives; Wayback is particular about archive provenance and integrity, for example.
https://www.loc.gov/preservation/digital/formats/fdd/fdd0005... ("CDX Internet Archive Index File")
https://www.loc.gov/preservation/digital/formats/fdd/fdd0002... ("WARC, Web ARChive file forma
Read the rest
t")
https://github.com/internetarchive/wayback/tree/master/wayba... ("Wayback CDX Server API - BETA")
I'm aware of this tool, but I'm sure there are caveats in terms of "totally" cloning a website:
https://github.com/ArchiveTeam/grab-site
In HTTrack Website CopierI would recommend grab-site instead if you’re archiving, but wget is easier if mirroring content.
https://github.com/ArchiveTeam/grab-site
In How to download a copy of a website using WgetThe format you want is WARC. Even the Library of Congress uses it. There are many many WARC scrapers. I'd look at what the Internet Archive recommends. A quick search turned up this from the Archive Team and Jason Scott https://github.com/ArchiveTeam/grab-site (https://wiki.archiveteam.org/index.php/Who_We_Are) but I found that in less than 15 seconds of searching so do your own diligence.
In Ask HN: How can I back up an old vBulletin forum without admin access?It’s possible the site owner has asked the Archive to dark site specific captures. Capture jobs will still run, but they won’t be available publicly (until some future date).
You can always run your own crawls with grab site: https://github.com/ArchiveTeam/grab-site
In Omg.lol: An Oasis on the InternetThere's github.com/ArchiveTeam/grab-site, but unfortunately it's not maintained very well.
In Help preserve the internet with Archiveteam's warriorWhy not use grab-site?
https://github.com/ArchiveTeam/grab-site
In How to archive a website that's shutting down soonHave you tried grab site [1]?
[1] https://github.com/ArchiveTeam/grab-site
In Authenticating Shared Web CachesIt would’ve been trivial to crawl the forum and dump the resulting WARC files into the Wayback machine to provide a permanent archive. This is just apathetic laziness on their part.
https://github.com/ArchiveTeam/grab-site
In The Unreal Engine Wiki is now permanently offlineRun grab-site [1] periodically (with the --no-offsite-links flag) and upload the resulting WARC files into an item in the Internet Archive. They can then be ingested by Wayback. If you prefer, I can do this for you as part of my existing archival operations.
[1] https://github.com/ArchiveTeam/grab-site
In The Wayback Machine: Fighting Digital Extinction in New WaysShowing the 15 most recent of 22 sources. Enable JavaScript to search and browse every indexed mention.