Oxen.ai

Oxen.ai is an open-source, Git-like data version control system optimized for large ML datasets, paired with the Oxen Hub SaaS for team collaboration.

Oxen.ai tackles the problem of versioning large machine learning datasets, which tools like git and git-lfs handle poorly at scale. It provides a Git-like command line interface and Python library so software engineers can adopt it quickly, but the internals are optimized for datasets rather than source code, efficiently handling images, audio, video, text, and tabular formats like Parquet with millions of rows. Performance is a core selling point: Oxen advertises being roughly 40x faster than git-lfs and even faster than a simple S3 copy, and it is designed to manage repositories with millions of files and terabytes of data. On top of the open-source engine sits the Oxen Hub, a SaaS platform for team collaboration, sharing, and hosting of dataset repositories. Oxen.ai targets ML teams that need reproducible, versioned data for training and evaluation, from training sets and model weights to game assets and studio media. Its git-like ergonomics make it a natural fit for engineers who want dataset workflows that mirror their code workflows.