| H200 SXM | H200 NVL | |
| GPU Architecture | NVIDIA Hopper | NVIDIA Hopper |
| GPU Memory | 141GB HBM3 | 141GB HBM3 |
| Memory Bandwidth | 4.8 TB/sec | 4.8 TB/sec |
| NVIDIA Tensor Cores | 528 | 528 |
| FP64 | 34 TFLOPS | 30 TFLOPS |
| FP64 Tensor Core | 67 TFLOPS | 60 TFLOPS |
| FP32 | 67 TFLOPS | 60 TFLOPS |
| TF32 Tensor Core | 989 TFLOPS | 835 TFLOPS |
| BELOAT16 Tensor Core | 1,979 TFLOPS | 1,671 TFLOPS |
| FP16 Tensor Core | 1,979 TFLOPS | 1,671 TFLOPS |
| FP8 Tensor Core | 3,958 TFLOPS | 3,341 TFLOPS |
| INT8 Tensor Core | 3,958 TFLOPS | 3,341 TFLOPS |
| INT4 | N/A | N/A |
| NVIDIA RT Cores | N/A | N/A |
| RT Core performance | N/A | N/A |
| Support MIG | Up to 7 MIGs @ 18GB each | Up to 7 MIGs @ 16.5GB each |
| Graphics Bus | PCI Express 5.0 x 16 | PCI Express 5.0 x 16 |
| Form Factor | SXM | Dual Slot |
| Max TDP Power | Up to 700W (configurable) | Up to 600W (configurable) |