Top Server GPUs Ranked by FP4 FLOPS of Matrix(Tensor) cores

Bandwidth Capacity

Memory

TF32 FP16 BF16 FP8 INT8 INT4

Matrix Compute

FP64 FP32 FP16 INT32 INT8

Vector Compute

#1

192 GB

NVIDIA B100

7000 T

8 TB/s

#2

96 GB

NVIDIA RTX PRO 6000 Blackwell

2015.22 T

1.79 TB/s