Standard HTTP VM curl 0.001s,
Pause VM execution and resume on networking 0.001s
Pause VM, dump mem to disk and free, then resume on networking 0.2s
Not too shabby π
Weekend hacky project has been fully implementing kvm in Go (including all virtio drivers), A custom init to do networking and start tetragon.io, then a full swap (new PIDs etc) into a new root derived from a Docker container. π (400ms to init, 600ms to OS)
I may be a bit late to the βtime to interactiveβ agent sandbox party, but I wanted to make sure our hypervisor absolutely MOGGED everyone else.
10x faster than Firecracker and 425x faster than Cloud Hypervisor.
agx.so is the best agent infra platform, period.
Whoβs going to FOSDEM in Brussels next week?
DM me if you'd like to hang out, talk about high performance cloud infrastructure, live migration, eBPF, Spot Instances - or all of the above!
Looking forward to meeting all the cool OSS folks!
Finally have a video of kube-gateway.io transparently modifying the behaviour of an AI application transparently. A few #kubernetes annotations and we can change the underlying API calls, in part thanks to eBPF π
Two pods with their traffic transparently proxied (thx eBPF π), one using in kernel TLS and the other user-land. Next step is to handle AI workloads. π€