pygooglenews

I open-sourced pyGoogleNews and wrote a quick blog about how you can reverse engineer google news RSS to turn it into an RSS feed of any website that is supported by Google News https://news.ycombinator.com/item?id=42343182 https://github.com/kotartemiy/pygooglenews

I have ~4k start in 2 Python libraries. Both help fetch live news articles. Links below. These were my first libraries. I took the approach of promoting them as any other product. You have to "sell" your code. Even if it's 100% free. In my opinion, the most important thing is DEMO. Just make a GIF where you showcase what your software does: * 80% of engineers won't even bother to read the description No one will spend their precious time trying to get through your code. [0] https://github.com/kotartemiy/newscatcher Programmatically collect normalized news from (almost) any website. [1] https://github.com/kotartemiy/pygooglenews If Google News had a Python library

I'm curious where the data get fetched from. The Author mentions that Mozilla Readability and SimplePie are used. Readability to parse the content. SimplePie to fetch the data (I assume). Dat from RSS feeds? In case you want to make something similar, I recently wrote a blog on where you could get news data for free [1] (self-promo) I'd recommend to take a look at my Python package to mine news data from Google News [2]. Also, in 3 days we're releasing an absolutely free News API [3] that will support ~50-100k top stories per day. [1] https://blog.newscatcherapi.com/an-ultimate-list-of-open-sou... [2] https://github.com/kotartemiy/pygooglenews [3] https://newscatcherapi.com/free-news-api

Write libraries AND services, where it makes sense. I wrote a Python library to scrape google news [0] We also have it as a service [1] Want to know why? Because devs who can't pay won't pay. Businesses who can pay will rather pay for a service (API in our case), and not care about maintaining it. [0] https://github.com/kotartemiy/pygooglenews [1] https://newscatcherapi.com/google-news-api

Nice job! I love the UI. For hackers who want to find the best open sourced tools to work/parse news data (disclaimer: I'm a creator to some of those): 1. PyGoogleNews [1] -- If Google News had a Python library 2. NewsCatcher [2] -- Programmatically collect normalized news from (almost) any website 3. NewsPaper3k [3] -- Article scraping & curation 4. Mercury Parser [4] -- Extracting content from chaos [1] https://github.com/kotartemiy/pygooglenews` [2] https://github.com/kotartemiy/newscatcher [3] https://github.com/codelucas/newspaper [4] https://github.com/postlight/mercury-parser

Good job. I recently made a Python library to scrape Google News: https://github.com/kotartemiy/pygooglenews

Over the past few months, I had somewhat as "writing a documentation for Google News RSS URL patterns" as my task. There is no such official documentation. Python package: https://github.com/kotartemiy/pygooglenews Blog post: https://codarium.substack.com/p/reverse-engineering-google-n...

This Python module doubles as the missing Google News feed API documentation: https://github.com/kotartemiy/pygooglenews/blob/master/pygoo...