Distributed inference is becoming a standard cloud native workload.
#llmd has joined the #CNCF Sandbox, bringing Kubernetes-native routing, orchestration, and disaggregated serving to AI inference.
Learn more: https://www.cncf.io/blog/2026/03/24/welcome-llm-d-to-the-cncf-evolving-kubernetes-into-sota-ai-infrastructure/
#Kubernetes #AI #CloudNative #CNCF
AI at the edge is an infrastructure puzzle. Red Hat is helping solve it by contributing llm-d to the #CNCF, establishing "well-lit paths" for AI-RAN orchestration with SoftBank. ๐ง
This is about optimizationโmaking inference a first-class citizen alongside traditional containers.
Proud to see Red Hat continuing our legacy of open-source leadership, from #Kubernetes and #etcd to #KEDA and now #llmd.
Red Hat is contributing llm-d to the #CNCF, turning fragmented AI into modular, interoperable microservices. ๐ง
The goal? Make AI inference a first-class citizen in the same cloud-native environment as your traditional apps.
I love how Red Hat continues to fuel the #OpenSource ecosystem. From our roots in #Kubernetes and #etcd to newer projects like #KEDA and #CRI-O, weโre committed to building "well-lit paths" for everyone.
Red Hat is contributing llm-d to the Cloud Native Computing Foundation (CNCF) as a Sandbox project to standardize high-performance, distributed AI inference serving within the cloud-native stack. This contribution aims to bridge the capabilities gap between AI experimentation and production by providing a specialized data-plane orchestration layer that maximizes infrastructure efficiency and enables flexible deployment on any choice of hardware.
3 things to know about Red Hat AI 3
https://www.youtube.com/watch?v=eztORiJWYMs
#RedHat #AI #RedHatAI #llmd #Agentic #MCP #ModelContextProtocol #LlamaStack #OpenSource #OpenShift #OpenShiftAI
Updating stickers on laptops... let's see how many I can tag
@matrix @ansible @InstructLab @thinkpadmuseum @trustyai @github @fedora
#ramalama #docling #vllm #llmd #pytorch #NERC #redhat #ospo #upstream #ansible #thinkpad #womeninfedora #expo2025 #kubeflow #trustyAI #cushingcenter #operationstickybusiness
Big thanks to everyone contributing code, reviews, and ideas โ this integration is shaping up to be a game-changer for ๐๐๐ฏ๐ฒ๐ฟ๐ป๐ฒ๐๐ฒ๐-๐ป๐ฎ๐๐ถ๐๐ฒ ๐๐๐ ๐๐ฒ๐ฟ๐๐ถ๐ป๐ด. Stay tuned for next release!
#KServe #llmd #GenerativeAI #MLOps #Kubernetes #ModelServing #AIInfrastructure
Red Hat Launches the llm-d Community, Powering Distributed Gen AI Inference at Scale
#RedHat #CoreWeave #Google #IBM #NVIDIA #AMD #Cisco #HuggingFace #Intel #Lambda #Mistral #OpenSource #AI #llmd #vllm #Linux #Kubernetes
Red Hat has launched llm-d, a new open source project developed in collaboration with industry leaders, designed to power distributed generative AI inference at scale. The project utilizes Kubernetes architecture, vLLM-based distributed inference, and intelligent AI-aware network routing to enable robust and scalable large language model (LLM) inference clouds.
The Linux Foundation
Chuck Mattern
Adam 
Carol Chen
Yuan Tang
Yuan Tang 
N-gated Hacker News