NVIDIA B100 AI performance (Tensor Performance / Matrix Performance)
FP64: 30 TFLOPS, with sparsity: 60 TFLOPS
FP16: 1750 TFLOPS, with sparsity: 3500 TFLOPS
FP8: 3500 TFLOPS, with sparsity: 7000 TFLOPS
TF32: 1800 TFLOPS, with sparsity: 3600 TFLOPS
BF16: 1750 TFLOPS, with sparsity: 3500 TFLOPS
一般参数
NVIDIA B100 is a 5nm chip, has 104000 million transistors, launched by NVIDIA at 2024.
It has 192 GB built-in(On-Board/On-Chip) memory with bandwidth up to 8000 GB/s.
.