defuddle

Defuddle (https://github.com/kepano/defuddle) by @kepano (CEO of Obsidian) is pretty damn good at getting a text-only version of random sites.

Yapit converts PDFs and web pages to audio, with a vision-LLM pipeline that handles math and complex layout instead of garbling them. I built it because I read a lot of papers and content online, but drift off after two paragraphs. Listening while following along keeps me focused and lowers the bar to actually start. Every TTS tool I tried broke on complex formatting. Papers with math, citations, figure references, page numbers in the middle of sentences. You either get garbled output or you're listening to raw LaTeX. Yapit converts everything to markdown as a common format. For web pages, defuddle (https://github.com/kepano/defuddle) handles the extraction and strips clutter from web pages, presenting the main article content in a clean, consistent format. For PDFs, a vision LLM rewrites each page into markdown with annotation tags that

Defuddle is an open-source JS library I built to parse and extract the main content and metadata from web pages. It can also return the content as Markdown. I built Defuddle while working on Obsidian Web Clipper[1] (also MIT-licensed) because Mozilla's Readability[2] appears to be mostly abandoned, and didn't work well for many sites. It's still very much a work in progress, but I thought I'd share it today, in light of the announcement that Mozilla is shutting down Pocket. This library could be helpful to anyone building a read-it-later app. Defuddle is also available as a CLI: https://github.com/kepano/defuddle-cli [1] https://github.com/obsidianmd/obsidian-clipper [2] https://github.com/mozilla/readability

I built Obsidian Web Clipper (open source, MIT) to replace my read-it-later app and save everything to local markdown files. Now that Obsidian Bases is available, it makes for a very nice web archival tool and reading experience. Here's a video: https://mastodon.social/@kepano/114553164915046938 You can use Web Clipper with any app that supports Markdown, not just Obsidian. Defuddle is the underlying HTML-to-Markdown library I made for Web Clipper, and can also be used as a CLI: https://github.com/kepano/defuddle https://github.com/kepano/defuddle-cli