rss-proxy

Rumours of RSS's demise are greatly exaggerated, I use it every day for dozens of sites. If a site does not offer an RSS feed one can be generated using something like rssproxy [1] or another implementation of this idea. [1] https://github.com/damoeb/rss-proxy

It will work well with RSS Proxy https://github.com/damoeb/rss-proxy which turns any website into an RSS feed.

I'm using it every day, that's what happens to it. Many sites provide their own feeds and those which don't can often be fed to something like rss-proxy [1] which will create a feed (or several feeds) based on an XPath query [2]. This can be self-hosted so you don't have to inform external entities about your feeding behaviour. [1] https://github.com/damoeb/rss-proxy [2] e.g. here's how to get Göteborgs Posten (a Swedish newspaper which ditched its feed some time ago) in an RSS feed reader (Atom is also supported through ...&o=Atom) - note that this is an example.org domain so the link does not work as is - https://rssproxy.example.org/api/feed?url=https://gp.se&pCon...

To elaborate on this, RSS-Bridge maintains custom extraction rules for many sites [1], but RSS-proxy attempts to do that for any site using some pretty nifty logic [2]. I tried it on a few pages and it seems to do its job accurately, if the HTML is good enough. Semantic HTML5 can be so helpful, especially in regards to tools like this one, or crawlers, or generally accessibility-wise. Unfortunately, its syntax is not enforced by browsers (for good reasons), so many developers never leverage it - and we end up with many custom-built sites falling back to <div>s everywhere, JS click handlers on non-interactive elements etc. I really wish modern framework docs and guides would more strongly hint to accessibility concerns. [1] https://github.com/RSS-Bridge/rss-bridge/tree/master/bridges [2] https://github.com/damoeb/rss-proxy/blob/master/pack

I created a automated HTML->Feed mapper [0], that simply analyzes the structure and offers you potential feeds. [0] https://github.com/damoeb/rss-proxy/

I wrote a general purpose tool for html to rss mapping, maybe what you are looking for. You can run it as a docker container. https://github.com/damoeb/rss-proxy

There are other opensource alternatives you might be interested in too [0], [1] and [2]. For rss-proxy you do not have to deal with selectors, though the feed quality won't be as good as the one OP suggests. [0] https://github.com/damoeb/rss-proxy/ [1] https://github.com/RSS-Bridge/rss-bridge [2] https://github.com/DIYgod/RSSHub

If you want to go crazy with RSS and build your entire information stream on top of it, you might need some glue code that semi-automatically turns static markup to rss [0]. (Disclaimer: I am the author) [0] https://github.com/damoeb/rss-proxy

To me RSS is exactly that. I don't see the advantage of converting an HTML to RDF because it would cover the entire spectrum. All the semantics might be lost. RSS is the smallest common denominator. If you agree somehow, you might be interested in that tool [0], it converts HTML to RSS using pattern matching. [0] https://github.com/damoeb/rss-proxy

I would love if people would see that their networks they maintain are of incredible value. As a consequence I would like to profit of e.g. information network a person x has. My idea is that every person exposes an aggregated RSS feed of feeds they consume. Every interesting person that tells me their secret RSS link would empower me. I started a couple of projects in that area, one is a piece of glue code [0] to automatically get a feed of a site, even if there isn't one. It maps html to a feed structure, which works decent, fixing broken feeds after the html changes is now the main concern. [0] https://github.com/damoeb/rss-proxy

For those who require very custom, niche feeds, you might want to try rss-proxy [0] which automatically maps HTML markup to RSS feeds. [0] https://github.com/damoeb/rss-proxy/

Maybe my side project rss-proxy [0] might be interesting for you. It automatically transforms static HTML markup to RSS, so ideally you would not need to write a parser manually. [0] https://github.com/damoeb/rss-proxy

If you looking for a niche feed, you might want to check out a general purpose feed generator rss-proxy [0]. It even supports JavaScript rendered pages. [1] https://github.com/damoeb/rss-proxy