HackerReposA FIELD GUIDE TO OPEN SOURCE
ProSponsor the shelf♧ 0
← Back to top all-time
kotartemiy
newscatcher
Python2020–2021
kotartemiy / newscatcher

newscatcher

Programmatically collect normalized news from (almost) any website.

4Distinct people
11Mentions
0Explicit recommenders
3KGitHub stars
REPOSITORY AT A GLANCE

What to know before exploring

What it is

Programmatically collect normalized news from (almost) any website.

GitHub

Where it is used

No documented product use has been verified yet.

What people are saying

No recommendation phrase was found in the indexed comments.

No classified warning is attached to this page. Read the discussions before treating silence as approval.

Also in these discussions

Mentioned in the same Hacker News threads. That is not proof they are substitutes.

This week on Hacker News

Nov 7–Nov 14 UTC · Direct repository links and separately labeled related project stories. Indexed through 11/14/2026, 5:04:57 PM UTC.

No direct repository links were found in the indexed HN discussions over the past seven days. Older discussions are available below.

Mentions over time

HN mentions by month11 dated mentions

Observed mentions: 2020-02-24 20:02:21 UTC to 2021-11-12 12:29:44 UTC.

01232020-02-01 00:00:00 UTC to 2020-03-01 00:00:00 UTC (exclusive): 1 mentions; 1 submissions, 0 commentsFeb 20202020-03-01 00:00:00 UTC to 2020-04-01 00:00:00 UTC (exclusive): 2 mentions; 0 submissions, 2 comments2020-04-01 00:00:00 UTC to 2020-05-01 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2020-05-01 00:00:00 UTC to 2020-06-01 00:00:00 UTC (exclusive): 3 mentions; 1 submissions, 2 comments2020-06-01 00:00:00 UTC to 2020-07-01 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2020-07-01 00:00:00 UTC to 2020-08-01 00:00:00 UTC (exclusive): 1 mentions; 0 submissions, 1 comments2020-08-01 00:00:00 UTC to 2020-09-01 00:00:00 UTC (exclusive): 1 mentions; 0 submissions, 1 comments2020-09-01 00:00:00 UTC to 2020-10-01 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2020-10-01 00:00:00 UTC to 2020-11-01 00:00:00 UTC (exclusive): 1 mentions; 0 submissions, 1 comments2020-11-01 00:00:00 UTC to 2020-12-01 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2020-12-01 00:00:00 UTC to 2021-01-01 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 commentsDec 20202021-01-01 00:00:00 UTC to 2021-02-01 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2021-02-01 00:00:00 UTC to 2021-03-01 00:00:00 UTC (exclusive): 1 mentions; 0 submissions, 1 comments2021-03-01 00:00:00 UTC to 2021-04-01 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2021-04-01 00:00:00 UTC to 2021-05-01 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2021-05-01 00:00:00 UTC to 2021-06-01 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2021-06-01 00:00:00 UTC to 2021-07-01 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2021-07-01 00:00:00 UTC to 2021-08-01 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2021-08-01 00:00:00 UTC to 2021-09-01 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2021-09-01 00:00:00 UTC to 2021-10-01 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2021-10-01 00:00:00 UTC to 2021-11-01 00:00:00 UTC (exclusive): 0 mentions; 0 submissions, 0 comments2021-11-01 00:00:00 UTC to 2021-12-01 00:00:00 UTC (exclusive): 1 mentions; 0 submissions, 1 commentsNov 2021

Counts come from the repository’s dated source evidence. Index cutoff: 2026-11-02 08:16:59 UTC.

View mention counts and date ranges
UTC ranges include their start and exclude their end. Select a period to filter the source evidence.
PeriodStart (UTC)End (exclusive, UTC)MentionsSubmissionsComments
Feb 20202020-02-01 00:00:00 UTC2020-03-01 00:00:00 UTC110
Mar 20202020-03-01 00:00:00 UTC2020-04-01 00:00:00 UTC202
Apr 20202020-04-01 00:00:00 UTC2020-05-01 00:00:00 UTC000
May 20202020-05-01 00:00:00 UTC2020-06-01 00:00:00 UTC312
Jun 20202020-06-01 00:00:00 UTC2020-07-01 00:00:00 UTC000
Jul 20202020-07-01 00:00:00 UTC2020-08-01 00:00:00 UTC101
Aug 20202020-08-01 00:00:00 UTC2020-09-01 00:00:00 UTC101
Sep 20202020-09-01 00:00:00 UTC2020-10-01 00:00:00 UTC000
Oct 20202020-10-01 00:00:00 UTC2020-11-01 00:00:00 UTC101
Nov 20202020-11-01 00:00:00 UTC2020-12-01 00:00:00 UTC000
Dec 20202020-12-01 00:00:00 UTC2021-01-01 00:00:00 UTC000
Jan 20212021-01-01 00:00:00 UTC2021-02-01 00:00:00 UTC000
Feb 20212021-02-01 00:00:00 UTC2021-03-01 00:00:00 UTC101
Mar 20212021-03-01 00:00:00 UTC2021-04-01 00:00:00 UTC000
Apr 20212021-04-01 00:00:00 UTC2021-05-01 00:00:00 UTC000
May 20212021-05-01 00:00:00 UTC2021-06-01 00:00:00 UTC000
Jun 20212021-06-01 00:00:00 UTC2021-07-01 00:00:00 UTC000
Jul 20212021-07-01 00:00:00 UTC2021-08-01 00:00:00 UTC000
Aug 20212021-08-01 00:00:00 UTC2021-09-01 00:00:00 UTC000
Sep 20212021-09-01 00:00:00 UTC2021-10-01 00:00:00 UTC000
Oct 20212021-10-01 00:00:00 UTC2021-11-01 00:00:00 UTC000
Nov 20212021-11-01 00:00:00 UTC2021-12-01 00:00:00 UTC101

What Hacker News says

11 sources
I have ~4k start in 2 Python libraries. Both help fetch live news articles. Links below. These were my first libraries. I took the approach of promoting them as any other product. You have to "sell" your code. Even if it's 100% free. In my opinion, the most important thing is DEMO. Just make a GIF where you showcase what your software does: * 80% of engineers won't even bother to read the description No one will spend their precious time trying to get through your code. [0] https://github.com/kotartemiy/newscatcher Programmatically collect normalized news from (almost) any website. [1] https://github.com/kotartemiy/pygooglenews If Google News had a Python library
In Tips For Making a Popular Open Source Project in 2021
Nice job! I love the UI. For hackers who want to find the best open sourced tools to work/parse news data (disclaimer: I'm a creator to some of those): 1. PyGoogleNews [1] -- If Google News had a Python library 2. NewsCatcher [2] -- Programmatically collect normalized news from (almost) any website 3. NewsPaper3k [3] -- Article scraping & curation 4. Mercury Parser [4] -- Extracting content from chaos [1] https://github.com/kotartemiy/pygooglenews` [2] https://github.com/kotartemiy/newscatcher [3] https://github.com/codelucas/newspaper [4] https://github.com/postlight/mercury-parser
In Show HN: Dato.rss – RSS Search
I think it will not harm. Usually, because people who cannot pay - will not. People/companies who need high quality products and/or have expensive labour will choose a paid plan. For Example, Elasticsearch. So popular, fully open-sourced. Still, Elastic sells fully managed clusters. And, many companies choose Enterprise license. If you want smaller example. 2 month prior the beta launch of NewsCatcherAPI (https://newscatcherapi.com) I decided to open source some code we've done (https://github.com/kotartemiy/newscatcher). We ended up having 300 people fro beta sign-up. Then, 700 pre-launch. So, I attracted lots of developers who already liked the field via open-sourcing Edit: grammar
In Ask HN: Is it a good practice to provide open-source version of your paid app?
While I was working on my “startup” one guy wrote me the following: “I lost my internship due to COVID. I’d like to help you guys with your project”. So, it was hard to us to find some job for the guy but we were open sourcing our job. I told the guy to work on a next version of our open-sourced Python package[1]. After we released it, it went #1 on Hacker News. I put him everywhere in the credits. You can still see him in our “Team” section[2]. The next day he got 2 offers. [1] https://github.com/kotartemiy/newscatcher [2] https://newscatcherapi.com/team
In Ask HN: How Blog/side projects helped you land a job
2 weeks ago, I released a Python package (700+ stars on GitHub) that "automagically scrapes" the last news from more than 3k news sources. You just have to provide the base form of URL. Behind the package is just a list of websites and their RSS URLs. For example, the input is "nytimes.com" and the output is all the latest news. So, it's quite alive. GitHub: https://github.com/kotartemiy/newscatcher
In Ask HN: Is RSS dead?

MAKE YOURSELF AT HOME

A few shortcuts

/
Search the collection
?
Open this guide
Esc
Close dialogs and navigation

Your saved repositories and interests stay in this browser.