Top Server GPUs Ranked by INT4 TOPS of Matrix(Tensor) cores

PC GPUServer GPUAll Processors

#1

80 GB
NVIDIA A100 SXM

1247.48 T

2.04 TB/s

#2

80 GB
NVIDIA A100 PCIe

1247.48 T

1.94 TB/s

#3

16 GB
AMD Radeon RX 9070 XT

778.57 T

644 GB/s

#4

48 GB
NVIDIA L40

724.13 T

864 GB/s

#5

48 GB
NVIDIA RTX A6000

619.32 T

768 GB/s

#6

48 GB
NVIDIA A40 PCIe

598.67 T

695 GB/s

#7

128 GB
AMD Instinct MI250X GPU

383 T

3.20 TB/s

#8

16 GB
NVIDIA Tesla T4

260.51 T

320 GB/s

#9

48 GB
AMD Radeon PRO W7900

245.27 T

864 GB/s

#10

32 GB
AMD Radeon PRO W7800

180.99 T

576 GB/s

#11

16 GB
AMD Radeon PRO W7700

127.80 T

576 GB/s

#12

28 GB
AMD Radeon PRO V710

110.59 T

504 GB/s

#13

8 GB
AMD Radeon PRO W7600

79.95 T

288 GB/s

#14

8 GB
AMD Radeon PRO W7500

48.74 T

172 GB/s