Top Server GPUs Ranked by FP8 FLOPS of Matrix(Tensor) cores

PC GPUServer GPUAll Processors

#1

192 GB
NVIDIA B100

3500 T

8 TB/s

#2

256 GB
AMD Instinct MI325X GPU

2614.90 T

6 TB/s

#3

192 GB
AMD Instinct MI300X GPU

2614.90 T

5.30 TB/s

#4

80 GB
NVIDIA H100 SXM

1979 T

3.36 TB/s

#5

141 GB
NVIDIA H200 SXM

1979 T

4.80 TB/s

#6

128 GB
AMD Instinct MI300A GPU

1961.20 T

5.30 TB/s

#7

141 GB
NVIDIA H200 NVL

1930.20 T

4.80 TB/s

#8

128 GB
Intel Gaudi 3 AI accelerator

1678 T

3.70 TB/s

#9

96 GB
Intel Gaudi 2 AI Accelerator

865 T

2.46 TB/s

#10

96 GB
NVIDIA RTX PRO 6000 Blackwell

503.80 T

1.79 TB/s

#11

16 GB
AMD Radeon RX 9070 XT

389.28 T

644 GB/s

#12

48 GB
NVIDIA L40

362.07 T

864 GB/s

#13

24 GB
NVIDIA L2 PCIe

193 T

300 GB/s