As I recently posted, I've grown interested in enterprise networking gear (like #omnipath and #dpus like those from Nvidia, Marvell, etc.)

The #xeonphi has seemed like a somewhat exotic platform worth of exploration.

What I'm finding is a relatively sparse amount of video content about these subjects. ServeTheHome has a series on DPUs. There's a smattering of older marketing content on OmniPath when it was an Intel product. And likewise, there's a handful of videos showcasing the Phi.

Inside the World's Largest AI Supercluster xAI Colossus

---

Summary

🚀 #Largest AI Supercomputer: The #xAI #Colossus is built with over 100,000 GPUs, massive storage, and #High Speed Networking, designed for #AI projects beyond typical #Chatbot applications.

🛠️ #Record Breaking Construction: The facility, containing over 100,000 GPUs, was constructed in just 122 days—significantly faster than traditional #Supercomputers that often take years.

💧 #Advanced Liquid Cooling System: The #Data Halls are equipped with #State Of The Art liquid cooling, using separate pipes for hot water and cold water, which efficiently manages #Heat from the #GPU Servers.

📊 #Scalable GPU Racks: Each rack includes multiple #NVIDIA #HGX H100 units, optimized with #Compact and easily serviceable designs, featuring #Cooling Manifolds and advanced #GPU configurations.

🔌 #Innovative Power Management: #Tesla #Mega Packs support the power demands of the #AI Clusters by managing microsecond power fluctuations, stabilizing #Energy Delivery to the GPU units.

🌐 #Ethernet Driven Networking: Unlike most #Supercomputers, the cluster uses #Ethernet Networking with #NVIDIA #Bluefield 3 #DPUs and #Spectrum X switches, offering robust 400 Gbps connections for efficient data flow.

https://youtu.be/Jf8EPSBZU7Y?si=Gi1i66febqSqjLt8

Inside the World's Largest AI Supercluster xAI Colossus

We FINALLY get to show the largest AI supercomputer in the world, xAI Colossus. This is the 100,000 (at the time we filmed this) GPU cluster in Memphis Tenne...

YouTube