A100 SXM4 | A100 SXM4 | A100 PCIe | A100 PCIe | A100X PCIe | |
GPU Architecture | NVIDIA Ampere | NVIDIA Ampere | NVIDIA Ampere | NVIDIA Ampere | NVIDIA Ampere |
GPU Memory | 40 GB HBM2 | 80GB HBM2e | 40GB HBM2 (EOL) | 80GB HBM2e | 80GB HBM2 |
Memory Bandwidth | 1,555 GB/sec | 2,039 GB/sec | 1,555 GB/sec | 1,940 GB/sec | 2,039 GB/sec |
NVIDIA CUDA® Cores | 6,912 | 6,912 | 6,912 | 6,912 | 6,912 |
NVIDIA Tensor Cores | 432 | 432 | 432 | 432 | 432 |
Network | N/A | N/A | N/A | N/A | 100Gb Dual Port (Ethernet or IB) |
Double-Precision | 9.7 TFLOPS | 9.7 TFLOPS | 9.7 TFLOPS | 9.7 TFLOPS | 9.7 TFLOPS |
Single-Precision |
FP32: 19.5 TFLOPS TF32: 156 TFLOPS | FP32: 19.5 TFLOPS TF32: 156 TFLOPS | FP32: 19.5 TFLOPS TF32: 156 TFLOPS | FP32: 19.5 TFLOPS TF32: 156 TFLOPS | FP32: 19.5 TFLOPS TF32: 156 TFLOPS |
Tensor Performance | N/A | N/A | N/A | N/A | N/A |
INT8 | 624 TOPS | 624 TOPS | 624 TOPS | 624 TOPS | 624 TOPS |
INT4 | 1,248 TOPS | 1,248 TOPS | 1,248 TOPS | 1,248 TOPS | 1,248 TOPS |
Support MIG | MAX: 7 MIGs @ 5GB each | MAX: 7 MIGs @ 10GB each | MAX: 7 MIGs @ 5GB each | MAX: 7 MIGs @ 10GB each | MAX: 7 MIGs @ 10GB each |
Networking | N/A | N/A | N/A | N/A | 100Gb Dual Port (Ethernet or IB) |
Graphics Bus | PCI Express 4.0 x 16 | PCI Express 4.0 x 16 | PCI Express 4.0 x 16 | PCI Express 4.0 x 16 | PCI Express 4.0 x 16 |
Form Factor | SXM | SXM | Dual Slot | Dual Slot | Dual Slot |
Max TDP Power | 400W | 400W | 250W | 300W | 300W |