sqlite-vector

This is a neat project - good API design, performance looks impressive. Note that this one isn't open source: https://github.com/sqliteai/sqlite-vector/blob/main/LICENSE.... The announcement says: > We believe the community could benefit from sqlite-vector, which is why we’ve made it entirely free for open-source projects. But that's not really how this works. If my open source projects incorporate aspects of this project they're no longer open source!

I think the whole field of vector databases is mostly just one huge misunderstanding. Most of you are not Google or any other big tech company so so won't have billions of embeddings. It's crazy how people add bloat and complexity to their stuff just because they want to do medium scale RAG with ca. 2 million embeddings. Here comes the punchline, you do not need a fancy vector database in this case. I stumbled over https://github.com/sqliteai/sqlite-vector which is a SQLite extension and I wonder why no one else did this before, but it simply implements a highly optimized brute force search over the vectors, so you get sub 100ms queries over millions of vectors with perfect recall. It uses dynamic runtime dispatch that makes use of the available SIMD instructions your CPU has. Turns out this might be all you need. No need for memory a mem