instructor_ex

The article is not correct. Perplexity has its own crawler and crawls sites directly. The nice thing about Perplexity is its source annotation. It will show you in real time how it's arriving at its data capture(s), and then annotate the results accordingly. It really is a lovely service. It has replaced the "normal" search engine for me, for most of my queries. And has completely replaced ChatGPT/Claude as it can fulfill those needs directly (and even let me choose to use one of those models). They also have an OpenAI-compatible API. I use it in conjunction with https://github.com/thmsmlr/instructor_ex

Yes, this is getting quite exciting. There is cross-pollinisation of concepts going on (e.g. https://www.youtube.com/watch?v=RABXu7zqnT0 which shows a port of Python's Instructor library to https://github.com/thmsmlr/instructor_ex, https://hexdocs.pm/scholar/Scholar.html etc!). That coupled with LiveView + (quite easy scaling in general) results into interesting opportunities.

If you’re using Elixir, I thought I’d point out how great this library is: https://github.com/thmsmlr/instructor_ex It piggybacks on Ecto schemas and works really well (if instructed correctly).