Oxen

We've been working for a few years on a VCS that is starting to get adopted by creative studios - called "Oxen" It's open source: https://github.com/oxen-AI/oxen Most users are building their own interface on top, but we also have a nice experience in our web ui: https://oxen.ai Would love people to try it out and give us feedback!

I do think git serves a lot of people's needs very well. I see a lot of people being quite happy with direct github alternatives. Self hosting may become more popular too, I hadn't heard too many self hosting stories until recently. If LFS is your pain (I cannot stand to use git lfs) I have to mention oxen, which is open source and self hostable, but also has a hosted option. It handles large files right out of the gate and doing so faster than everyone else is one of its core missions. Still using github for distribution though, lol, see https://github.com/Oxen-AI/Oxen. I am also curious about where jj will go, its philosophy is really interesing, and sounds promising.

We're also working on an open source large asset versioning tool called "oxen" - https://github.com/Oxen-AI/Oxen Would love any feedback on it or contributions if people are interested :)

The premise is that Git-LFS sucks, so we need to build a new data versioning system (in Rust, from scratch). While I mostly agree with this premise, but there are already lots of existing (mature) data versioning systems with the same tricks under the hood: - Pachyderm (Go): https://github.com/pachyderm/pachyderm - XetHub (acquired by HuggingFace): https://huggingface.co/blog/xethub-joins-hf - LakeFS (Go): https://github.com/treeverse/lakeFS - Oxen (Rust): https://github.com/Oxen-AI/Oxen I guess with AI, anyone can vibe code a content-addressed, chunk-level deduped, versioning system in Rust these days... But jokes aside, Lore seems really cool! What's interesting is the realization that different domains/industries have similar problems, but they don't seem to be cross-polinating. In this case AI and Gaming both need a storage system th

We're working on this project to help with the non-text file and large file problem: https://github.com/Oxen-AI/Oxen Started with the machine learning use case for datasets and model weights but seeing a lot of traction in gaming as well. Always open for feedback and ideas to improve if you want to take it for a spin!

One of the maintainers of the Open Source project "Oxen" here. Our VCS scales for binary data better than git does, and was built to solve some of the problems with git-lfs and git-annex. We've had a few requests to integrate with music production workflows, but haven't taken it on yet. If anyone wants to collaborate to integrate Oxen with their DAW or workflow let us know! Here's the project: https://github.com/Oxen-AI/Oxen

We built `oxen` to solve the issues we (and many others) had with DVC and LFS. The highlights: open source cli and server, mirrors git for easy learning, handles large files and millions of files, performant af. Would love feedback if you check it out. https://github.com/Oxen-AI/Oxen or check out the performance numbers https://docs.oxen.ai/features/performance

We're working on `oxen` to solve a lot of the problems we ran into with git or git-lfs. We have an open source CLI and server that mirrors git, but handles large files and mono repos with millions of files in a much more performant manner. Would love feedback if you want to check it out! https://github.com/Oxen-AI/Oxen

How big are your datasets? Working on an Open Source git-lfs replacement called "oxen" if you are interested. https://github.com/Oxen-AI/Oxen

This is a problem that occurs across game development to ML datasets. We built oxen to solve this problem https://github.com/Oxen-AI/Oxen (I work at Oxen.ai) Source control for large data. Currently our biggest repository is 17 TB. would love for you to try it out. It's open source, so you can self host as well.

We're working on Oxen.ai which is an Open Source CLI and Server with Python bindings as well. Optimized for ML/AI workloads but works with any type of data and we see usage from game companies, bio, aerospace etc. Feel free to check it out here: https://github.com/Oxen-AI/oxen-release Or a hub you can host data on (we have public and private repos, or private VPC deployments): https://oxen.ai The CLI mirrors git so it's easy to learn. It has some interesting build in tooling for diff-ing datasets and working on them remotely without downloading a full copy of the data as well. Happy to answer any other questions!

How does it compare to Oxen? https://github.com/Oxen-AI/Oxen

Hey all, We added a recently added a data diff tool to the Oxen.ai toolchain. Feel free to checkout the docs here: https://docs.oxen.ai/concepts/diffs If you aren’t familiar with Oxen.ai we are building dataset version control optimized for structured datasets of csvs, jsonl, parquet files, etc as well as multimodal datasets of images, audio, video, text, etc. We wanted add a tool to the toolchain that could quickly narrow down schema changes as well as find added/removed/modified rows in data frames. The hope is that this will be a more powerful tool than a git diff when it comes to iterating on datasets. With data you are no longer scanning line by line to verify changes - but dealing with data distributions and data frames. You can pipe these diffs into any data analysis tool (pandas, polars, your custom Jupyter notebook) and quickly g

We've been working on a data version control system called "oxen" optimized for large unstructured datasets that we are seeing more and more with the advent of many of the generative AI techniques. Many of these datasets have many many images, videos, audio files, text as well as structured tabular datasets that git or git-lfs just falls flat on. Would love anyone to kick the tires on it and let us know what you think: https://github.com/Oxen-AI/oxen-release The commands are mirrored after git so it is easy to learn, but optimized under the hood for larger datasets.

We have been working on an open source tool called "Oxen" that aims to tackle this problem! Would love for you to kick the tires and see if it works for your use case. We have a free version of the CLI, python library, and server on github, and a free hosted version you can kick around at Oxen.ai. Website: https://oxen.ai Dev Docs: https://docs.oxen.ai GitHub: https://github.com/Oxen-AI/oxen-release Feel free to reach out on the repo issues if you run into anything!