At #CES2025, AMD demonstrated its latest Instinct #MI325X accelerator for #AI and #HPC workloads, which also happens to be the world's only processor with 256 GB of HBM3E and promises to be one of the most efficient #GPUs for #inference www.tomshardware.com/tech-industr...

AMD's Instinct MI325X smiles f...
Bluesky

Bluesky Social
#AMD's Instinct #MI325X smiles for the camera: 256 GB of HBM3E
AMD's Instinct MI325X comes with the same dual-chiplet #GPU that powers the Instinct MI300X and features 19,456 stream processors (304 compute units) clocked at up to 2.10 GHz. However, the new accelerator is equipped with 256 GB of HBM3E memory featuring 6 TB/s of bandwidth, as opposed to 192 GB of HBM3 memory with 5.3 TB/s of bandwidth.
https://www.tomshardware.com/tech-industry/artificial-intelligence/amds-instinct-mi325x-smiles-for-the-camera-256-gb-of-hbm3e
AMD's Instinct MI325X smiles for the camera: 256 GB of HBM3E

But will it beat Nvidia's H200 with 141 GB of memory?

Tom's Hardware
AMD Instinct MI325X: nuovo acceleratore AI sfida NVIDIA H200

AMD Instinct MI325X, nuovo acceleratore AI, sfida NVIDIA con prestazioni superiori. Disponibile entro fine anno, è destinato a rivoluzionare il settore AI.

CeoTech