Forsta runs Buoyant Enterprise for Linkerd across 40+ Azure Kubernetes clusters, roughly 2,000 pods per cluster, and about 400 services. Running it takes barely 0.1% of their operational headcount. Read the case study: hubs.ly/Q04Brjdy0
Couple of weeks ago I was a guest on #TheAIKubernetes Show where I had a good conversation with @wm about what it actually takes to run AI workloads on Kubernetes.
Most load balancers route on URL path. The OpenAI API spec puts the model ID in the request body. Standard load balancing doesn't work for model-based LLM routing. The Gateway API Inference Extension was built specifically for this.
We also got into agentic workloads and why they're different from inference, the identity and resource management challenges, and where Kubernetes is heading over the next year.
Watch our conversation: lnkd.in/dE9-p-r6#TheAIKubernetesShow#Kubernetes#AgenticAI#LLMInference
First thing I saw walking into the #KubeCon keynote hall this morning: @wm -ception!
ALT Wide shot of a keynote hall. Mostly dark except for multiple screens showing the same speaker, William Morgan of Buoyant, presenting infornation about Linkerd service mesh.
Big news for Linkerd and Windows users! Linkerd 2.19 just dropped, making us the *first* service mesh to officially support Windows nodes in Kubernetes. Get ready to extend Linkerd's power to your containerized Windows applications. Learn more 👉 hubs.ly/Q03QXXb40