We’re entering the agentic AI era — and infrastructure is evolving fast.

NVIDIA’s new Vera Rubin platform brings together specialized chips (Vera CPUs, Rubin GPUs, Groq LPUs, and BlueField-4 DPUs) into coordinated, rack-scale systems designed for real-time AI.

Instead of relying on a single processor type, this architecture splits AI workloads across purpose-built components — enabling faster inference, lower latency, and more efficient “AI factories” at scale.

The big shift: AI isn’t just about training models anymore — it’s about orchestrating entire systems to power intelligent, autonomous agents in real time.

https://www.buysellram.com/blog/the-agentic-ai-era-how-nvidia-rubin-vera-cpu-groq-3-lpus-bluefield-4-redefine-the-inference-factory/

#NVIDIAGTC #AgenticAI #VeraRubin #DataCenter #GPU #InferenceFactory #TechStrategy #AIInfrastructure #Groq #TechNews #NVIDIA #NVLink #AIHardware #technology

We’re entering the agentic AI era — and infrastructure is evolving fast.

NVIDIA’s new Vera Rubin platform brings together specialized chips (Vera CPUs, Rubin GPUs, Groq LPUs, and BlueField-4 DPUs) into coordinated, rack-scale systems designed for real-time AI.

Instead of relying on a single processor type, this architecture splits AI workloads across purpose-built components — enabling faster inference, lower latency, and more efficient “AI factories” at scale.

The big shift: AI isn’t just about training models anymore — it’s about orchestrating entire systems to power intelligent, autonomous agents in real time.

https://www.buysellram.com/blog/the-agentic-ai-era-how-nvidia-rubin-vera-cpu-groq-3-lpus-bluefield-4-redefine-the-inference-factory/

#NVIDIAGTC #AgenticAI #VeraRubin #DataCenter #GPU #InferenceFactory #TechStrategy #AIInfrastructure #Groq #TechNews #NVIDIA #NVLink #AIHardware #technology

NVIDIA’s new Vera Rubin platform brings together specialized chips (Vera CPUs, Rubin GPUs, Groq LPUs, and BlueField-4 DPUs) into coordinated, rack-scale systems designed for real-time AI.

The big shift: AI isn’t just about training models anymore — it’s about orchestrating entire systems to power intelligent, autonomous agents in real time.
https://www.buysellram.com/blog/the-agentic-ai-era-how-nvidia-rubin-vera-cpu-groq-3-lpus-bluefield-4-redefine-the-inference-factory/
#NVIDIAGTC #AgenticAI #VeraRubin #DataCenter #GPU #InferenceFactory #AIInfrastructure #Groq #NVIDIA #NVLink #AIHardware #technology

Một người dùng muốn dùng 2 card RTX 3090 kết nối qua 2 Oculink x4 (PCIe 4.0) để kích hoạt NVLink phục vụ AI/render. Họ hỏi: NVLink có hoạt động ổn? Bandwidth có đủ không? Đã có ai thử chưa? #GPU #NVLINK #AI #Hardware #ThiếtBịCôngNghệ #TríTuệNhânTạo

https://www.reddit.com/r/LocalLLaMA/comments/1qqdpjz/nvlink_2x_3090_which_are_connected_via_2x_oculink/

NVIDIA V100 SXM2 gặp sự cố liên kết NVLink không hoạt động. Chủ đề này được thảo luận trên Reddit, nơi người dùng LeastExperience1579 đang tìm kiếm giải pháp sau khi mua máy chủ Supermicro từ nước ngoài. #nvidia #techsupport #NVLink #V100SXM2 #gpu #server #trợgiúptech

https://www.reddit.com/r/LocalLLaMA/comments/1q71s8s/nvlink_inactive_v100_sxm2/

Cập nhật thử nghiệm mô hình MiniMax-M2 Q3_K_M với 4 GPU V100 32GB qua llama.cpp và NVLink. Khi dùng "--split-mode layer", tốc độ xử lý tăng từ 20 lên 38 tok/s so với "row", đạt 1683 tok/s khi khởi tạo. Tuy NVLink chưa tối ưu cho inference, nhưng combo V100 16GB SXM2 giá ~$100 + adapter ($50) vẫn đáng cân nhắc cho các dự án DIY. #AI #LLM #llamaCPP #NVLink #V100 #DOITech

https://www.reddit.com/r/LocalLLaMA/comments/1psnlm0/minimaxm2_q3_k_m_on_quad_v100_32gb_llamacpp/

8x AMD Instinct #MI355X (288GB @8TB/s) take back the lead over 8x Nvidia #B200 (180GB @8TB/s) in #FluidX3D #CFD, achieving 362k MLUPs/s (vs. 219k MLUPs/s). Thanks to Jon Stevens from Hot Aisle to run the benchmarks! 🖖😊

In single-GPU, both perform about the same, but in 8x #GPU config, MI355X is 65% faster. The difference comes from PCIe bandwidth - MI355X does 55GB/s, B200 only 14GB/s. #Nvidia leaves a lot of perf on the table by not exposing #NVLink P2P to #OpenCL.

https://github.com/ProjectPhysX/FluidX3D