html-to-markdown

I learned that the golang CLI[1] is the best through my work simplifying Firecrawl[2]. However, in this case I used one available through npmjs such that it would work with `npx` for the CF worker builds. [1]: https://github.com/JohannesKaufmann/html-to-markdown [2]: https://github.com/devflowinc/firecrawl-simple

I'm frequently constructing context based on up-to-date docs using curl + html2markdown[0] and custom css selectors, which is extremely tedious. MCP servers for docs would be very useful for me. That said, I don't really expect the AI itself to come up with docs to read (maybe some day). I want it predominantly so I can manually reference it in my prompt (in e.g. the Zed assistant panel) like `/npmdocs packagename packageversion`. But even for AI "self-driven" use-cases, I primarily see the value in read-only MCP servers that provide more context, just in an "as-needed" way, instead of me putting it there explicitly. [0]: https://github.com/JohannesKaufmann/html-to-markdown

Yeah good point, that's actually difficult. They use many `<span>` html tags to color individual words and syntax. But I wrote logic to handle that. It probably needs to be adapted at some point, but works surprisingly well. Have a look at the testdata files ("code.in.html" and "code.out.md" files [1]). Feel free to give it a try & let me know if you notice any edge cases! [1] https://github.com/JohannesKaufmann/html-to-markdown/blob/ma...

Hey HN! I originally built “html-to-markdown” back in 2018 (while still in high school) to handle complex HTML conversions where other libraries struggled. Now, I’ve released v2 — a complete rewrite designed to handle even more edge cases. It supports entire websites with a high accuracy. Example use: I’ve used it in my RSS reader to strip HTML down to clean Markdown, similar to the "Reader Mode" in your Browser. It can be used as a Golang package or as an CLI. Give it a try & tell me what edge cases you encounter!

Cool to see another library in this space! I see that you took the test cases from Turndown. However Turndown isn’t actually that accurate. This is especially noticeable when converting entires websites. The best comparison would be against Pandoc. That is (in my opinion) the best html to markdown converter right now. Although it is extremely difficult to handle every edge case. As an example, this usually causes problems: <p>nitty<em>-gritty-</em>details</p> Note: Six years ago I open sourced a Golang library [1]. Currently I am re-writing it completely with the aim of getting even better than Pandoc. And wrote about the encountered edge-cases [2]. [1] https://github.com/JohannesKaufmann/html-to-markdown [2] https://html-to-markdown.com/edge-cases