AMD Instinct MI325X
High-memory CDNA 3 refresh for large-model inference
~$16000
Datacenter
256GB
HBM3e
6000
GB/s bandwidth
163.4
FP32 TFLOPS
1000W
TDP
19456
cores
5nm
process
// about AMD Instinct MI325X
High-memory CDNA 3 refresh for large-model inference
// similar hardware in Datacenter
NVIDIA B200
NVIDIA Blackwell flagship datacenter GPU for frontier model training
NVIDIA · Datacenter · N/A
NVIDIA GB200 NVL72
Rack-scale Grace Blackwell superchip for trillion-parameter models
NVIDIA · Datacenter · N/A
NVIDIA GB300 NVL72
Rack-scale Blackwell Ultra superchip with expanded memory
NVIDIA · Datacenter · N/A
NVIDIA H100 PCIe
PCIe-form-factor Hopper datacenter GPU
NVIDIA · Datacenter · ~$25000
NVIDIA H100 SXM
Hopper-architecture datacenter GPU for large-scale AI training
NVIDIA · Datacenter · ~$30000
NVIDIA H200
High-memory Hopper refresh for large-model inference
NVIDIA · Datacenter · ~$32000