24GB
GDDR6
600
GB/s bandwidth
35
FP32 TFLOPS
300W
TDP
9216
cores
8nm
process
// about NVIDIA A10G
AWS-favored Ampere GPU for graphics and inference
// similar hardware in Datacenter
NVIDIA B200
NVIDIA Blackwell flagship datacenter GPU for frontier model training
NVIDIA · Datacenter · N/A
NVIDIA GB200 NVL72
Rack-scale Grace Blackwell superchip for trillion-parameter models
NVIDIA · Datacenter · N/A
NVIDIA GB300 NVL72
Rack-scale Blackwell Ultra superchip with expanded memory
NVIDIA · Datacenter · N/A
NVIDIA H100 PCIe
PCIe-form-factor Hopper datacenter GPU
NVIDIA · Datacenter · ~$25000
NVIDIA H100 SXM
Hopper-architecture datacenter GPU for large-scale AI training
NVIDIA · Datacenter · ~$30000
NVIDIA H200
High-memory Hopper refresh for large-model inference
NVIDIA · Datacenter · ~$32000