GPUs

Hardware for AI inference and training - VRAM, power, throughput, pricing, and availability.

GPUVendorVRAMTDPFP16 TFLOPsINT8 TOPsPriceCategoryStatus
H100 SXM5NVIDIA80GB700W
1979
3958
$30,000Data CenterAvailable
H200 SXMNVIDIA141GB700W
1979
3958
$40,000Data CenterAvailable
A100 SXM4 80GBNVIDIA80GB400W
312
624
$10,000Data CenterAvailable
RTX 4090NVIDIA24GB450W
82.6
165
$1,599ConsumerAvailable
RTX 5090NVIDIA32GB575W
209
838
$1,999ConsumerAvailable
MI300XAMD192GB750W
1307
2614
$15,000Data CenterAvailable
Gaudi 3Intel128GB600W
1835
3670
$12,000Data CenterAvailable
TPU v5pGoogle96GB450W
459
918
CloudCloudCloud Only
Trainium2Amazon96GB700W
380
760
CloudCloudCloud Only
RX 7900 XTXAMD24GB355W
61.4
123
$999ConsumerAvailable