datasets

It got tagged as open source, you can see it in the csv [1]. But the original comment didn't have a link and table I shared was filtered to just posts with links to the repo. [1] https://github.com/getomni-ai/datasets/blob/main/hn_projects... [2] https://news.ycombinator.com/item?id=41342592

Since this is a CSV on GitHub: https://github.com/getomni-ai/datasets/blob/main/hn_projects... You can open it in Datasette Lite (WebAssembly in your browser) to run SQLite SQL against it like this: https://lite.datasette.io/?csv=https://github.com/getomni-ai... Here's a SQL query showing just the open source projects focused on AI, for example: https://lite.datasette.io/?csv=https://github.com/getomni-ai...

The latest Ask HN: What are you working[1] on thread just dropped. And to give my own answer, building structured datasets! I wrote a quick scraper for the HN comments. Just pulling every top level comment along with its replies as a nested object. This ended up pulling 642 top level comments with about 458 replies. I created a posrgres db with this original data set. The replies I just concatenated together in the order they came in (with an indent field to mark what level comment it was. Then stringified the json array and added it to the db. I generated the structured data using my own tool of course (OmniAI[2]). And pulled out the following values: - project_category - Enum - PERSONAL_PROJECT, STARTUP, SELF_IMPROVEMENT, OTHER - is_open_source - Boolean - github_link - String - project_industry - Enum - SOFTWARE_DEVELOPMENT, HEALTHCARE