tarit

Building a replacement for firecracker. Thinking ground up what AI agents would need rather than struggling later on with snapshotting live vms, or orchestration overhead etc. rust-vmm proved really great for this. https://github.com/instavm/tarit

We will be soon including this in Tarit, a firecracker alternative https://github.com/instavm/tarit Currently we have to supply a kernel to run the OCI as a microVM with a warm pool. TARIT_KERNEL=/path/vmlinux taritd image build --oci ubuntu:24.04 --name ubuntu taritd vm create --image ubuntu

Our nixos sandboxes are mostly a cloud offering at this time. Scale is what we can offer additionally. Have secret injection built in too. I see you have suspend, resume we have the same. We have snapshots and cloning. Startup time is sub second with warm pools - which will go further down when we replace firecracker with Tarit soon. 1. Tarit - https://GitHub.com/instavm/tarit

We have built Tarit as a hypervisor built from ground up for running AI agent and RL environments. It is based on rust-vmm and can be used as a replacement for firecracker. Firecracker was built to serve a different need of primarily serverless compute and hence does not have primitives like live snapshots without pausing the VM operations. We also provide a basic orchestrator that handles placement of the microVMs, creating clusters with HA, maintaining a warm pool of VMs, and takes care of setting up networking and monitoring. Our benchmarks on a metal instance shows an acquire VM from pool and execute code p99 of 35ms which places it as one of the fastest VM based sandboxes you can get right now. You could also snapshot a small sandbox and resume in ~80ms. You can easily self-host a multi-node cluster of this right now on your cloud w