quickwit

I don't believe there is just one answer to that, because it really depends on your needs, existing stack, and skillset. Disclaimer aside, I've heard very positive things about the search that ships with PostgreSQL, and similarly positive things for the few search extensions one can add (assuming extensions are available where you're running PG) https://github.com/quickwit-oss/tantivy#features seems to be a good starting place if you want to embed search, and its https://github.com/quickwit-oss/quickwit friend comes up a lot, but be sure to bear its AGPL license in mind Toshi is one of the ones which is striving for ES compatibility at the search level, making it a drop-in replacement https://github.com/toshi-search/Toshi#example-queries although last time I played with it, they were QUITE A WAYS away, depending on how deep one is in the

> It’s in no way mainly for logs as they claim Where can I find more information on using it for user-facing search? The repository [0] starts with "Cloud-native search engine for observability (logs, traces, and soon metrics!)" and keeps talking about those. [0]: https://github.com/quickwit-oss/quickwit

If you don't need vector search and have very large Elasticsearch deployment, you can have a look at Quickwit, it's a search engine on object storage, it's OSS and works for append-only datasets (like logs, traces, ...) Repo: https://github.com/quickwit-oss/quickwit

Here's a sampling of stuff I've semi-recently encountered on Github that all spy on you by default. For some, it's undocumented, for others it's a minor subsection in the docs. (Some of them are source-available not free, I didn't keep track as I collected the URLs.) https://github.com/zed-industries/zed https://github.com/microsoft/vscode https://github.com/keystonejs/keystone https://github.com/meilisearch/meilisearch https://github.com/hasura/graphql-engine https://github.com/manticoresoftware/manticoresearch/ https://github.com/coder/code-server https://github.com/loft-sh/devpod https://github.com/quickwit-oss/quickwit https://github.com/rilldata/rill-developer/ https://github.com/hocus-dev/hocus https://github.com/firezone/firezone Here's a write-up of how bad it gets -- it's pretty obnoxious: https://www.roboleary.net/tools/2022/04/

Found recently Tantivy inside of ParadeDB (Postgres extension aiming to replace Elastic) https://github.com/paradedb/paradedb/blob/dev/pg_search/Carg... after listening Extending Postgres for High Performance Analytics (with Philippe Noël) https://www.youtube.com/watch?v=NbOAEJrsbaM And inside of the main thing - Quickwit(logs, traces, and soon metrics) https://github.com/quickwit-oss/quickwit Had a surprisingly good experience with combined power of Quickwit and Clickhouse for multilingual search pet project. Finally something usable for Chinese, Japanese, Korean https://quickwit.io/docs/guides/add-full-text-search-to-your... to_tsvector in PG never worked well for my use cases SELECT * FROM dump WHERE to_tsvector('english'::regconfig, hh_fullname) @@ to_tsquery('english'::regconfig, 'query'); Wish them to succeed. Will automatically up

Quickwit is an alternative with a strong focus on scalability (max we have seen is 40PB) with a decoupled compute and storage architecture. But we do only logs and traces for now. Repository: https://github.com/quickwit-oss/quickwit Latest release: https://quickwit.io/blog/quickwit-0.8

Hi everyone, During the last 3 months, I worked on the Quickwit search engine to adapt it for AWS Lambda runtime. I wrote a blog post to announce the beta release [0] and two tutorials to quickstart: - Indexing and searching 20 million logs entries dataset [1]. - Implementing an E2E use case where an application generates data, uploads it in batches to S3. Users can then search through an HTTP API authenticated with an API Key [2]. On the performance side, I observed on a 20 million log dataset that search is sub-second, and analytics queries take from 1 to 4 second. On the cost side, obviously the compute using Lambda is fairly expensive, but the huge win is that it scales to 0. Few other solutions do. For instance OpenSearch Serverless has a fixed cost around $700/months. On the search side, thanks to indexing, queries are usually way c

Hi folks, Quickwit cofounder here. We started Quickwit 3 years ago with a POC, "Searching the web for under $1000/month" (see HN discussions [0]), with the goal of making a robust OSS alternative to Elasticsearch / Splunk / Datadog. We have reached a significant milestone with our latest release (0.7) [1], as we have witnessed users of the nightly version of Quickwit deploy clusters with hundreds of nodes, ingest hundreds of terabytes of data daily, and enjoy considerable cost savings. To give you a concrete example, one company is ingesting hundreds of terabytes of logs daily and migrating from Elasticsearch to Quickwit. They divided their compute costs by 5x and storage costs by 2x while increasing retention from 3 to 30 days. They also increased their durability, accuracy with exactly-once semantics thanks to the native Kafka support,

Hi HN, Quickwit cofounder here! Quickwit is a cloud-native search engine for observability, and we have just released a significant upgrade with performance improvements, extended Elasticsearch API compatibility, and better integration with OpenTelemetry tools, Grafana, and Jaeger. This release is also a significant milestone as we have been witnessing users of the nightly version of Quickwit deploy clusters with hundreds of nodes, ingest hundreds of terabytes of data daily, and enjoy additional cost savings. We are very excited to put it in the hands of all of our users. One report particularly compelling is coming from a company ingesting hundreds of terabytes of logs daily and migrating from Elasticsearch to Quickwit, dividing their compute costs by 5x and storage costs by 2x while increasing retention from 3 to 30 days. They also incr