quickwit

Oh! Damn it I forgot about manticore -- I had seen it before but forgot to include it. Eventually all of these projects will be highlighted on Awesome F/OSS (https://awsmfoss.com), but for now I'm just going to dump my bookmarks here for other people, since I'm leaving awesome projects out: Search Engines AWS OpenSearch https://github.com/opensearch-project/OpenSearch https://github.com/opensearch-project/OpenSearch-Dashboards https://github.com/opensearch-project/perftop https://github.com/go-ego/riot https://groonga.org/ https://github.com/groonga/groonga https://github.com/meilisearch/MeiliSearch https://github.com/mosuka/bayard https://github.com/nezaboodka/nevod https://github.com/searx/searx https://github.com/stryku/okon https://github.com/toshi-search/Toshi https://github.com/typesense/typesense https://github.com/valeriansaliou/s

Quickwit does too (a subset anyway): https://github.com/quickwit-oss/quickwit

Quickwit is a search engine built on top of Tantivy (by the author of Tantivy): https://github.com/quickwit-oss/quickwit Quickwit supports Elasticsearch compatible bulk indexing API.

I wish we had an extension like ZomboDB but using a lighter search engine like https://github.com/quickwit-oss/quickwit, https://github.com/toshi-search/Toshi and https://github.com/mosuka/bayard Here I'm listing engines based on https://github.com/quickwit-oss/tantivy - tantivy is comparable to Lucene in its scope - but I'm sure there are other engines that could tackle ElasticSearch. Another thing that could happen is maybe directly embed tantivy in Postgres using an extension, perhaps this could be an option too.

(disclaimer: I'm one of the cofounder of Quickwit.io, we are doing log search) (edited to add vector search category and add manticore) When looking at OSS search projects, it's nice to have a rough ideas of the different use cases, here is the list I have in mind: - user facing search (think algolia): elasticsearch[1]/opensearch[2], meilisearch[3], typesense[4] - enterprise search: elasticsearch/opensearch - log search: elasticsearch/opensearch, loki[5], quickwit[6], zincsearch[7] - vector search: Milvus[8], Qdrant[9], Vald[10] Weaviate[11] Vespa.ai[12] is great but I don't really know in which category to put them, user facing and enterprise search seems to work well with them. It's interesting to note that Elasticsearch and Opensearch are general purpose search engine, Solr as well. They are all powered by Lucene, the popular and per

Another alternative to ES and Lucene respectively - QuickWit (https://github.com/quickwit-oss/quickwit) and Tantivy (https://github.com/quickwit-oss/tantivy).

Quickwit | Senior Software Engineer | Remote (Europe, Middle East, Asia) | Full-time Quickwit is the next-gen open-source search engine for logs at petabyte-scale data - https://github.com/quickwit-oss/quickwit. We are looking for an engineering generalist with extensive experience writing Rust code and leading technical architecture. Working with large data sets, dealing with complex distributed systems, and developing backend services should be second nature. Our search engine is coded in Rust and the following features are on our roadmap: - distributed indexing - aggregations (min, max, count, sum, avg, ...) for search queries - gossip protocol for cluster formation We bring particular attention to high performance, high reliability, and code quality. Learn more and apply at https://quickwit.io/jobs/distributed-software-engineer

Nice article indeed, we ended up implementing the exact same architecture at Quickwit for... log search! :) https://twitter.com/fulmicoton/status/1526776987553263616 https://github.com/quickwit-oss/quickwit

Quickwit CEO here. For people interested, we are focusing on immutable data (logs of all kinds typically). https://github.com/quickwit-oss/quickwit We make it much 10x cheaper and easier to scale and operate. We store the index on Amazon S3.

Awesome. I've tried MeiliSearch and it is very easy to set up and use. It works very well for less than a million of data. The only let down for me is their very slow indexing speed when it comes to millions to tens of millions of data (personal experience, also experienced by other users in their public slack workspace). Other competitors / alternatives: - https://github.com/typesense/typesense - https://github.com/quickwit-oss/quickwit - https://github.com/elastic/elasticsearch - https://github.com/valeriansaliou/sonic A decent feature-by-feature comparison: - https://typesense.org/typesense-vs-algolia-vs-elasticsearch-... If you guys know other open-source competitors / alternatives, I'd love to check those out!

Glad to hear your interest, we have a list of sources we want to support here https://github.com/quickwit-inc/quickwit/issues/1000 You can manifest your interest, this will help us prioritise in our roadmap.