Top Server GPUs Ranked by INT8 TOPS of Matrix(Tensor) cores

2614.90 T

5.30 TB/s

2614.90 T

6 TB/s

1979 T

4.80 TB/s

1979 T

3.36 TB/s

1961.20 T

5.30 TB/s

1930.20 T

4.80 TB/s

1007.61 T

1.79 TB/s

623.74 T

2.04 TB/s

623.74 T

1.94 TB/s

389.28 T

644 GB/s

383 T

3.20 TB/s

362.10 T

3.20 TB/s

#13

48 GB
NVIDIA L40

362.07 T

864 GB/s

309.66 T

768 GB/s

299.34 T

695 GB/s

193 T

300 GB/s

184.60 T

1.20 TB/s

181 T

1.60 TB/s

130.25 T

320 GB/s

122.63 T

864 GB/s

90.50 T

576 GB/s

63.90 T

576 GB/s

55.30 T

504 GB/s

39.98 T

288 GB/s

24.37 T

172 GB/s