Top Server GPUs Ranked by BF16 FLOPS of Vector(Shader/CUDA) cores

PC GPUServer GPUCPUAll Processors

#1

80 GB
NVIDIA H100 SXM

133.80 T

3.36 TB/s

#2

80 GB
NVIDIA A100 PCIe

38.98 T

1.94 TB/s

#3

80 GB
NVIDIA A100 SXM

38.98 T

2.04 TB/s

#4

48 GB
NVIDIA RTX A6000

38.71 T

768 GB/s

#5

48 GB
NVIDIA A40 PCIe

37.42 T

695 GB/s

#6

128 GB
Intel Gaudi 3 AI accelerator

28.70 T

3.70 TB/s

#7

96 GB
Intel Gaudi 2 AI Accelerator

11 T

2.46 TB/s