dolt

Dolt does this: https://github.com/liquidata-inc/dolt. You can import from either CSV or directly from XLS.

We built a Git-style version controlled SQL database called Dolt (https://github.com/liquidata-inc/dolt) mentioned deep in this thread. It allows diffs and merges across schema and data based on commits. We are focused on the data distribution/open data use case (https://www.liquidata.co/blog/2019-10-09-where-is-the-data-c..., https://www.liquidata.co/blog/2019-12-06-the-history-of-data...) but I think a number of use cases mentioned in this thread are covered by Dolt. You do have to move a copy of your data to Dolt, it does not sit on top or beside of your current database. So, it is an extra step in your data modification workflow, similar to versioning code. You had to add a version control step into your code modification workflow.

Congratulations to the Quilt team on the launch! Quilt reached out to me and suggested I chime in suggesting that people interested in versioning data also check out Dolt (https://github.com/liquidata-inc/dolt) and DoltHub (https://www.dolthub.com). We've taken the Git and GitHub for data analogy a lot more literally than Quilt has :-) We are a SQL database with native Git semantics. Instead of versioning files like Git, we version table rows. This allows for diff and conflict detection down to the cell level. We are built on top of another open source project called Noms (https://github.com/attic-labs/noms). We think there is a ton of room in this space for a bunch of tools: Quilt, Noms, QRI (https://qri.io/), Pachyderm (https://www.pachyderm.io/), and even Git. We're excited to see so many bright minds trying to solve this problem. We'r

Sirix sounds like a very interesting system! Is it similar in its internal structure to noms (https://github.com/attic-labs/noms) or Dolt (https://github.com/liquidata-inc/dolt)? I think S3 is a good match for storing database pages as long as they are immutable. The Vectorized query processing model seems to fit this approach very well (e.g., http://oai.cwi.nl/oai/asset/14075/14075B.pdf) Anyone out there from Snowflake care to answer how Snowflake stores database pages in AWS? I haven't used BookKeeper or Pulsar myself so I can't comment on how well they might work for distributing an intent log.

On August 6, we launched Dolt - Git for data open source (https://github.com/liquidata-inc/dolt). Today we publicly launched DoltHub (https://www.dolthub.com), a place on the internet to share Dolt repositories. Dolt is a SQL database that natively supports Git semantics like commits, branches, and merges. It uses a custom engine that versions table rows not files so diffs and merges are fast. The structural sharing of rows across versions allows Dolt to scale to large table sizes. DoltHub is to Dolt as GitHub is to Git. The data community can post and collaborate on open databases much as the open source community collaborates on open source. Over the next few months we're going to work really hard to publish open, maintained, and updated data on DoltHub that you can't easily get anywhere else on the internet. Think every LinkedIn resume

My company built a SQL database with git semantics. It's called Dolt. Instead of versioning files, it versions tables. Find out more at https://www.dolthub.com. We just launched the project open source: https://github.com/liquidata-inc/dolt. Please help us out with a star or even better download it and try it out.