Kubernetes is becoming the default for AI infrastructure. CNCF highlighted the convergence - same orchestration benefits for distributed training and inference.

NVIDIA's Nemotron 3 Super targets agentic AI with 5x throughput, shipping Kubernetes deployment cookbooks for vLLM and SGLang.

If ML and containers are separate in your stack, time to reconsider.