databend

Yes, Databend's metadata service (https://github.com/databendlabs/databend/tree/main/src/meta) also uses a Raft implementation written in Rust: https://github.com/databendlabs/openraft. We've been running OpenRaft in production for several years now and have found it to be quite stable. It's designed as a generic, feature-complete Raft library that handles the complexities of distributed consensus well. If you're looking for a mature Rust Raft implementation, it's definitely worth considering.

Looking forward to adding Databend, the open-source alternative to Snowflake: https://github.com/databendlabs/databend/issues/13059

The snowset[1] in the post is quite dated—it’s based on data from February 21 to March 7, 2018, which doesn't reflect current usage trends. Many users find Snowflake too expensive now, especially with the added costs of ETL. With the rise of open-source alternatives like Databend[2], users have more options when considering a move away from Snowflake. [1]snowset: https://github.com/resource-disaggregation/snowset [2]Databend: https://github.com/datafuselabs/databend

Check out Databend, an open-source alternative to Snowflake with 90%+ product and syntax similarity (almost no migration cost). It’s cost-effective and powerful. GitHub: https://github.com/datafuselabs/databend/issues/13059 Comparison: https://www.databend.com/comparison

UUID v7's timestamp is a game-changer for Databend. We're using it to quickly locate metadata files on AWS S3 by timestamp, making operations like vacuuming much faster. PR: https://github.com/datafuselabs/databend/pull/16049

Databend is a cutting-edge alternative to Snowflake, offering cost-effective and straightforward solutions for large-scale analytics. It utilizes a lightweight meta service instead of the resource-intensive FoundationDB and employs OpenRaft for replication and high availability. - Databend: https://github.com/datafuselabs/databend - OpenRaft: https://github.com/datafuselabs/openraft

Managing costs with Snowflake's virtual warehouse is more straightforward, allowing you to adjust the warehouse's size and operational status to control expenses. However, optimizing costs for Snowflake's cloud service is more complex. Each SQL query incurs costs for parsing and planning. These costs, less transparent than warehouse expenses, increase as your business and request volume grow, making budgeting and cost control challenging. To address this, consider DatabendCloud – a cost-effective alternative to Snowflake, built entirely in Rust. Key Benefits of DatabendCloud: *Significant cost savings, over 50% compared to Snowflake. *Similar user experience to Snowflake, with comparable syntax and product functionalities. *Minimal to no cloud service fees; costs are primarily based on warehouse usage. *Transparent pricing model, allowing

Interesting! However, it's important to note that S3 Select isn't ideal for handling large-scale data scans, as this can lead to exorbitant costs. In contrast, Databend(https://github.com/datafuselabs/databend) utilizes S3 primarily for storage purposes. Key functionalities like bloom filter indexing, min-max indexing, aggregating indexing, join reordering, and filter pushdown are all managed within the query layer. This approach optimizes performance and cost-efficiency, particularly when dealing with substantial amounts of data.

Indeed, under a pay-as-you-go model, if there's a lack of precise control over the warehouse, such as a 10-minute suspension, it could lead to significant waste. This is because most queries might only take a few seconds, and the rest of the time is wasted. If you find Snowflake expensive, consider Databend. It's an open-source, cost-efficient alternative to Snowflake, and it maintains a consistent product experience with Snowflake. Open-source: https://github.com/datafuselabs/databend Databend vs. Snowflake: https://github.com/datafuselabs/databend/issues/13059 Cloud: https://app.databend.com/

Link to Github: https://github.com/datafuselabs/databend

Databend is a powerful cloud data warehouse. Built for elasticity and efficiency. Free and open. Also available in the cloud: https://app.databend.com . - GitHub: https://github.com/datafuselabs/databend/ - Roadmap 2023: https://github.com/datafuselabs/databend/issues/9448