nsfw_data_source_urls

Interesting work! Thanks for putting this together. One potentially problematic thing about the new Imgur policy is that it will break machine learning projects that depend on Imgur for NSFW data. For example, here's a project relying on Imgur links in order to train a classifier that detects adult content: https://github.com/alex000kim/nsfw_data_scraper https://github.com/EBazarov/nsfw_data_source_urls

To be honest, I have no idea. See https://github.com/EBazarov/nsfw_data_source_urls/ for the data source I used. There is a Reddit bulk downloader capable of downloading ~1000 images from a subreddot: https://github.com/aliparlakci/bulk-downloader-for-reddit (or just image links, if needed); I tested it and it works well. Though, I have no idea if it was used for the project.

Project that provide lists of URLs that will help you download NSFW images, this set can be used in building big enough dataset to train robust NSFM classification model. https://github.com/EBazarov/nsfw_data_source_urls This work was inspired by https://github.com/alexkimxyz/nsfw_data_scrapper and for downloading images suggested to use scripts from the scraper. You will find different txt files each of them contains list of URLs, here some stats for this set: - 159 different categories - in total 1 589 331 URLs - after downloading and cleaning it's possible to have ~500GB or in other words ~1 300 000 of NSFW images