DGX H100 | |
GPUs | 8x NVIDIA H100 80 GB GPUs |
GPU Memory | 640 GB Total |
NVLink (GPU to GPU bandwidth) | 900 GB/s |
Performance | 32 petaFOPS FP8 |
NVIDIA CUDA® Cores | 135,168 |
NVIDIA Tensor Cores | 4,224 |
Maximum Power Usage | ~10.2kW max |
CPU | Dual x86 |
System Memory | 2 TB |
Network | NVIDIA CONNECTX-7 *8 |
Storage |
Data: 30TB (8X
3.84 TB) NVMe SSD OS: 2X 1.92TB NVMe SSD |