Top Server GPUs Ranked by FP32 FLOPS of Matrix(Tensor) cores

PC GPUServer GPUCPUAll Processors

#1

128 GB
Intel Gaudi 3 AI accelerator

229 T

3.70 TB/s

#2

256 GB
AMD Instinct MI325X GPU

163.40 T

6 TB/s

#3

192 GB
AMD Instinct MI300X GPU

163.40 T

5.30 TB/s

#4

128 GB
AMD Instinct MI300A GPU

122.60 T

5.30 TB/s

#5

128 GB
AMD Instinct MI250X GPU

95.70 T

3.20 TB/s

#6

128 GB
AMD Instinct MI250 GPU

90.50 T

3.20 TB/s

#7

32 GB
AMD Instinct MI100 GPU

46.10 T

1.20 TB/s

#8

64 GB
AMD Instinct MI210 GPU

45.30 T

1.60 TB/s

#9

28 GB
AMD Radeon PRO V710

27.65 T

504 GB/s