DGX A100 640GB (F)(10xNICs) | DGX A100 640GB (L)(5xNICs) | DGX A100 320GB (H)(9xNICs) | DGX A100 320GB (L)(5xNICs) | |
GPUs | 8x NVIDIA A100 80 GB GPUs | 8x NVIDIA A100 80 GB GPUs | 8x NVIDIA A100 40 GB GPUs | 8x NVIDIA A100 40 GB GPUs |
GPU Memory | 640 GB Total | 640 GB Total | 320 GB Total | 320 GB Total |
NVLink (GPU to GPU bandwidth) | 600 GB/s | 600 GB/s | 600 GB/s | 600 GB/s |
Performance | 5 PetaFLOPS AI ; 10 petaOPS INT8 | 5 PetaFLOPS AI ; 10 petaOPS INT8 | 5 PetaFLOPS AI ; 10 petaOPS INT8 | 5 PetaFLOPS AI ; 10 petaOPS INT8 |
NVIDIA CUDA® Cores | 55,296 | 55,296 | 55,296 | 55,296 |
NVIDIA Tensor Cores | 3,456 | 3,456 | 3,456 | 3,456 |
Maximum Power Usage | 6,500 W | 6,500 W | 6,500 W | 6,500 W |
CPU | Dual AMD Rome 7742 2.25GHz, 64-Core | Dual AMD Rome 7742 2.25GHz, 64-Core | Dual AMD Rome 7742 2.25GHz, 64-Core | Dual AMD Rome 7742 2.25GHz, 64-Core |
System Memory | 2 TB DDR4 RDIMM | 2 TB DDR4 RDIMM | 1 TB DDR4 RDIMM | 1 TB DDR4 RDIMM |
Network | 200Gb Single Port *8, 200G Dual Port *2 | 200Gb Single Port *4, 200G Dual Port *1 | 200Gb Single Port *8, 200Gb Dual Port *1 | 200Gb Single Port *4, 200Gb Dual Port *1 |
Storage |
Data: 30TB (8X 3.84 TB) NVMe
SSD OS: 2X 1.92TB NVMe SSD |
Data: 30TB (8X 3.84 TB) NVMe
SSD OS: 2X 1.92TB NVMe SSD |
Data: 15TB (4X 3.84 TB) NVMe
SSD OS: 2X 1.92TB NVMe SSD |
Data: 15TB (4X 3.84 TB) NVMe
SSD OS: 2X 1.92TB NVMe SSD |