Top Server GPUs Ranked by TF32 FLOPS of Matrix(Tensor) cores

PC GPUServer GPUAll Processors

#1

192 GB
NVIDIA B100

1800 T

8 TB/s

#2

192 GB
AMD Instinct MI300X GPU

653.70 T

5.30 TB/s

#3

256 GB
AMD Instinct MI325X GPU

653.70 T

6 TB/s

#4

80 GB
NVIDIA H100 SXM

494.70 T

3.36 TB/s

#5

141 GB
NVIDIA H200 SXM

494 T

4.80 TB/s

#6

128 GB
AMD Instinct MI300A GPU

490.30 T

5.30 TB/s

#7

141 GB
NVIDIA H200 NVL

482.55 T

4.80 TB/s

#8

128 GB
Intel Gaudi 3 AI accelerator

459 T

3.70 TB/s

#9

80 GB
NVIDIA A100 SXM

155.93 T

2.04 TB/s

#10

80 GB
NVIDIA A100 PCIe

155.93 T

1.94 TB/s

#11

96 GB
NVIDIA RTX PRO 6000 Blackwell

125.95 T

1.79 TB/s

#12

48 GB
NVIDIA L40

90.52 T

864 GB/s

#13

48 GB
NVIDIA RTX A6000

77.41 T

768 GB/s

#14

48 GB
NVIDIA A40 PCIe

74.83 T

695 GB/s