Top GPUs & CPUs & AI accelerators Ranked by FP16 FLOPS of Matrix(Tensor) cores

This is NOT a ranking of gaming performance, it's a ranking for AI workloads.
This is NOT a ranking of processors—many of them may be missing since their specifications aren’t available. If you know them, feel free to comment.
This is NOT a ranking of actual task performances, as they may vary due to many factors like thermal throttling, driver support, and framework compatibility...
PC GPUServer GPUCPUAll Processors

#1

GPU
192 GB
NVIDIA B100

1750 T

8 TB/s

#2

GPU
192 GB
AMD Instinct MI300X GPU

1307.40 T

5.30 TB/s

#3

GPU
256 GB
AMD Instinct MI325X GPU

1307.40 T

6 TB/s

#4

GPU
141 GB
NVIDIA H200 SXM

990 T

4.80 TB/s

#5

GPU
80 GB
NVIDIA H100 SXM

989.40 T

3.36 TB/s

#6

GPU
128 GB
AMD Instinct MI300A GPU

980.60 T

5.30 TB/s

#7

GPU
141 GB
NVIDIA H200 NVL

965.10 T

4.80 TB/s

#8

GPU
128 GB
Intel Gaudi 3 AI accelerator

459 T

3.70 TB/s

#9

AIU
96 GB
AWS Trainium2

431 T

4 TB/s

#10

CPU
Intel Xeon 6980P

419.43 T

844.80 GB/s

#11

CPU
Intel Xeon 6979P

393.22 T

844.80 GB/s

#12

GPU
128 GB
AMD Instinct MI250X GPU

383 T

3.20 TB/s

#13

GPU
128 GB
AMD Instinct MI250 GPU

362.10 T

3.20 TB/s

#14

CPU
Intel Xeon 6972P

344.06 T

844.80 GB/s

#15

CPU
Intel Xeon 6952P

314.57 T

844.80 GB/s

#16

GPU
80 GB
NVIDIA A100 SXM

311.87 T

2.04 TB/s

#17

GPU
80 GB
NVIDIA A100 PCIe

311.87 T

1.94 TB/s

#18

CPU
Intel Xeon w9-3595X

294.91 T

307.20 GB/s

#19

CPU
Intel Xeon 6788P

281.80 T

409.60 GB/s

#20

CPU
Intel Xeon 6787P

281.80 T

512 GB/s

#21

CPU
Intel Xeon 6960P

280.17 T

844.80 GB/s

#22

CPU
Intel Xeon w9-3495X

275.25 T

307.20 GB/s

#23

CPU
Intel Xeon 6781P

262.14 T

512 GB/s

#24

AIU
NVIDIA DRIVE AGX Thor

250 T

#25

CPU
Intel Xeon 6768P

249.04 T

409.60 GB/s

#26

CPU
Intel Xeon 6761P

235.93 T

512 GB/s

#27

CPU
Intel Xeon 6944P

228.56 T

614.40 GB/s

#28

CPU
Intel Xeon 6760P

222.82 T

409.60 GB/s

#29

CPU
Intel Xeon w9-3575X

216.27 T

307.20 GB/s

#30

CPU
Intel Xeon 6767P

209.72 T

512 GB/s

#31

GPU
32 GB
NVIDIA GeForce RTX 5090

209.51 T

1.79 TB/s

#32

CPU
Intel Xeon Platinum 8593Q

196.61 T

358.40 GB/s

#33

GPU
16 GB
AMD Radeon RX 9070 XT

194.64 T

644 GB/s

#34

CPU
Intel Xeon Platinum 8592+

190.05 T

358.40 GB/s

#35

CPU
Intel Xeon Platinum 8592V

190.05 T

307.20 GB/s

#36

CPU
Intel Xeon Platinum 8581V

190.05 T

307.20 GB/s

#37

AIU
32 GB
AWS Trainium1

190 T

820 GB/s

#38

CPU
Intel Xeon 6747P

186.78 T

512 GB/s

#39

CPU
Intel Xeon 6748P

186.78 T

409.60 GB/s

#40

GPU
32 GB
AMD Instinct MI100 GPU

184.60 T

1.20 TB/s

#41

CPU
Intel Xeon 6741P

181.86 T

409.60 GB/s

#42

GPU
48 GB
NVIDIA L40

181.03 T

864 GB/s

#43

GPU
64 GB
AMD Instinct MI210 GPU

181 T

1.60 TB/s

#44

CPU
Intel Xeon Platinum 8580

178.18 T

358.40 GB/s

#45

CPU
Intel Xeon w9-3475X

176.95 T

307.20 GB/s

#46

CPU
Intel Xeon Platinum 8570

172.03 T

358.40 GB/s

#47

CPU
Intel Xeon Platinum 8481C

166.30 T

307.20 GB/s

#48

GPU
24 GB
NVIDIA GeForce RTX 4090

165.15 T

1.01 TB/s

#49

CPU
Intel Xeon 6740P

162.20 T

409.60 GB/s

#50

CPU
Intel Xeon Platinum 8571N

159.74 T

307.20 GB/s

#51

CPU
Intel Xeon Platinum 8558P

157.29 T

358.40 GB/s

#52

GPU
16 GB
Intel Arc A770

157.29 T

512 GB/s

#53

CPU
Intel Xeon w7-3565X

157.29 T

307.20 GB/s

#54

CPU
Intel Xeon Platinum 8568Y+

157.29 T

358.40 GB/s

#55

GPU
48 GB
NVIDIA RTX A6000

154.83 T

768 GB/s

#56

GPU
48 GB
NVIDIA A40 PCIe

149.67 T

695 GB/s

#57

CPU
64 GB
Intel Xeon Max 9480

149.09 T

1.60 TB/s

#58

CPU
Intel Xeon Platinum 8468H

147.46 T

307.20 GB/s

#59

CPU
Intel Xeon Platinum 8558

147.46 T

332.80 GB/s

#60

GPU
16 GB
AMD Radeon RX 9070

144.51 T

644 GB/s

#61

CPU
64 GB
Intel Xeon Max 9470

143.77 T

1.60 TB/s

#62

CPU
Intel Xeon Platinum 8558U

142.54 T

307.20 GB/s

#63

CPU
Intel Xeon w7-3555

137.63 T

307.20 GB/s

#64

GPU
8 GB
Intel Arc A750

137.63 T

512 GB/s

#65

CPU
Intel Xeon w7-3465X

137.63 T

307.20 GB/s

#66

CPU
Intel Xeon 6745P

134.35 T

512 GB/s

#67

CPU
Intel Xeon 6731P

134.35 T

409.60 GB/s

#68

GPU
16 GB
Intel Arc A770M

134.35 T

512 GB/s

#69

CPU
Intel Xeon 6738P

134.35 T

409.60 GB/s

#70

CPU
Intel Xeon Gold 6458Q

131.07 T

307.20 GB/s

#71

CPU
Intel Xeon 6737P

131.07 T

512 GB/s

#72

CPU
64 GB
Intel Xeon Max 9468

127.80 T

1.60 TB/s

#73

CPU
Intel Xeon w7-2595X

127.80 T

153.60 GB/s

#74

GPU
32 GB
NVIDIA Tesla V100 SXM2 32 GB

125.34 T

898 GB/s

#75

CPU
Intel Xeon 6736P

125.34 T

409.60 GB/s

#76

CPU
Intel Xeon 6553P-B

125.34 T

204.80 GB/s

#77

CPU
Intel Xeon 6726P-B

124.72 T

204.80 GB/s

#78

CPU
Intel Xeon Platinum 8562Y+

124.52 T

358.40 GB/s

#79

GPU
24 GB
AMD Radeon RX 7900 XTX

122.78 T

960 GB/s

#80

GPU
48 GB
AMD Radeon PRO W7900

122.63 T

864 GB/s

#81

CPU
Intel Xeon 6530P

121.24 T

409.60 GB/s

#82

CPU
Intel Xeon 6563P-B

120.63 T

204.80 GB/s

#83

CPU
Intel Xeon 6706P-B

118.78 T

204.80 GB/s

#84

CPU
Intel Xeon 6716P-B

118.78 T

204.80 GB/s

#85

CPU
Intel Xeon w7-3545

117.96 T

307.20 GB/s

#86

CPU
Intel Xeon 6730P

117.96 T

409.60 GB/s

#87

CPU
Intel Xeon w7-3455

117.96 T

307.20 GB/s

#88

CPU
Intel Xeon w7-2495X

117.96 T

153.60 GB/s

#89

GPU
12 GB
Intel Arc B580

116.53 T

456 GB/s

#90

CPU
Intel Xeon Gold 6548N

114.69 T

332.80 GB/s

#91

CPU
Intel Xeon Gold 6548Y+

114.69 T

332.80 GB/s

#92

GPU
16 GB
NVIDIA GeForce RTX 5080

112.55 T

960 GB/s

#93

CPU
Intel Xeon Gold 6554S

110.59 T

332.80 GB/s

#94

CPU
64 GB
Intel Xeon Max 9460

110.59 T

1.60 TB/s

#95

CPU
Intel Xeon w7-2575X

108.13 T

153.60 GB/s

#96

CPU
Intel Xeon 6556P-B

106.91 T

204.80 GB/s

#97

GPU
16 GB
NVIDIA GeForce RTX 4080 SUPER

104.45 T

736 GB/s

#98

CPU
Intel Xeon 6527P

103.22 T

409.60 GB/s

#99

GPU
20 GB
AMD Radeon RX 7900 XT

102.96 T

800 GB/s

#100

CPU
64 GB
Intel Xeon Max 9462

101.58 T

1.60 TB/s

#101

GPU
12 GB
Intel Arc A730M

100.76 T

336 GB/s

#102

CPU
Intel Xeon 6521P

100.76 T

409.60 GB/s

#103

CPU
Intel Xeon w5-3535X

98.30 T

307.20 GB/s

#104

GPU
8 GB
Intel Arc A580

98.30 T

512 GB/s

#105

CPU
Intel Xeon w7-2475X

98.30 T

153.60 GB/s

#106

CPU
Intel Xeon w7-3445

98.30 T

307.20 GB/s

#107

GPU
16 GB
NVIDIA GeForce RTX 4080

97.47 T

716 GB/s

#108

GPU
24 GB
NVIDIA L2 PCIe

96.50 T

300 GB/s

#109

AIU
MLU 370

96 T

#110

CPU
Intel Xeon 6728P

95.85 T

409.60 GB/s

#111

CPU
Intel Xeon Gold 6538N

95.03 T

332.80 GB/s

#112

CPU
Intel Xeon 6546P-B

95.03 T

204.80 GB/s

#113

GPU
16 GB
AMD Radeon RX 7900 GRE

91.96 T

576 GB/s

#114

CPU
Intel Xeon Gold 6438Y+

91.75 T

307.20 GB/s

#115

CPU
Intel Xeon Gold 6438M

91.75 T

307.20 GB/s

#116

GPU
32 GB
AMD Radeon PRO W7800

90.50 T

576 GB/s

#117

CPU
Intel Xeon Gold 6438N

88.47 T

307.20 GB/s

#118

CPU
Intel Xeon Gold 6530

88.47 T

307.20 GB/s

#119

CPU
Intel Xeon Gold 6542Y

88.47 T

332.80 GB/s

#120

CPU
Intel Xeon w7-2565X

88.47 T

153.60 GB/s

#121

GPU
16 GB
NVIDIA GeForce RTX 4070 Ti SUPER

88.20 T

672 GB/s

#122

GPU
16 GB
NVIDIA GeForce RTX 5070 Ti

87.88 T

896 GB/s

#123

CPU
Intel Xeon Gold 5512U

86.02 T

307.20 GB/s

#124

CPU
Intel Xeon Gold 5520+

86.02 T

307.20 GB/s

#125

CPU
Intel Xeon 6533P-B

85.20 T

179.20 GB/s

#126

CPU
Intel Xeon Gold 6430

85.20 T

281.60 GB/s

#127

CPU
Intel Xeon Gold 6414U

85.20 T

307.20 GB/s

#128

CPU
Intel Xeon 6543P-B

85.20 T

179.20 GB/s

#129

CPU
Intel Xeon Gold 6421N

85.20 T

281.60 GB/s

#130

CPU
Intel Xeon 6520P

83.56 T

409.60 GB/s

#131

CPU
Intel Xeon Gold 6428N

81.92 T

256 GB/s

#132

CPU
Intel Xeon 6523P-B

81.10 T

179.20 GB/s

#133

CPU
Intel Xeon Gold 5411N

80.28 T

281.60 GB/s

#134

GPU
12 GB
NVIDIA GeForce RTX 4070 Ti

80.18 T

504 GB/s

#135

GPU
24 GB
NVIDIA GeForce RTX 3090 Ti

79.99 T

1.01 TB/s

#136

CPU
Intel Xeon w5-3525

78.64 T

307.20 GB/s

#137

CPU
Intel Xeon Gold 5420+

77.41 T

281.60 GB/s

#138

GPU
16 GB
AMD Radeon RX 7900M

77.05 T

576 GB/s

#139

CPU
Intel Xeon w5-2465X

77.00 T

153.60 GB/s

#140

CPU
Intel Xeon w5-3435X

77.00 T

307.20 GB/s

#141

GPU
16 GB
AMD Radeon RX 7800 XT

74.65 T

624 GB/s

#142

GPU
12 GB
AMD Radeon RX 7800M

71.73 T

432 GB/s

#143

CPU
Intel Xeon Silver 4516Y+

71.27 T

281.60 GB/s

#144

GPU
24 GB
NVIDIA GeForce RTX 3090

71.16 T

936 GB/s

#145

GPU
12 GB
NVIDIA GeForce RTX 4070 SUPER

70.96 T

504 GB/s

#146

GPU
12 GB
AMD Radeon RX 7700 XT

70.34 T

432 GB/s

#147

CPU
Intel Xeon w7-2555X

68.81 T

153.60 GB/s

#148

CPU
Intel Xeon 6724P

68.81 T

409.60 GB/s

#149

CPU
Intel Xeon 6517P

68.81 T

409.60 GB/s

#150

GPU
12 GB
NVIDIA GeForce RTX 3080 Ti

68.20 T

912 GB/s

#151

CPU
Intel Xeon 6511P

67.17 T

409.60 GB/s

#152

GPU
8 GB
Intel Arc A550M

67.17 T

224 GB/s

#153

CPU
Intel Xeon Gold 6544Y

67.17 T

332.80 GB/s

#154

GPU
16 GB
NVIDIA GeForce RTX 4090 Laptop

65.96 T

576 GB/s

#155

CPU
Intel Xeon Gold 6444Y

65.54 T

307.20 GB/s

#156

GPU
16 GB
NVIDIA Tesla T4

65.13 T

320 GB/s

#157

GPU
16 GB
AMD Radeon PRO W7700

63.90 T

576 GB/s

#158

GPU
24 GB
NVIDIA GeForce RTX 5090 Laptop

63.61 T

896 GB/s

#159

CPU
Intel Xeon 6515P

62.26 T

409.60 GB/s

#160

GPU
12 GB
NVIDIA GeForce RTX 5070

61.73 T

672 GB/s

#161

GPU
10 GB
NVIDIA GeForce RTX 3080

59.54 T

760 GB/s

#162

CPU
Intel Xeon 6516P-B

59.39 T

153.60 GB/s

#163

CPU
Intel Xeon Silver 4416+

59.39 T

256 GB/s

#164

GPU
12 GB
NVIDIA GeForce RTX 5070 Ti Laptop

59.35 T

768 GB/s

#165

GPU
12 GB
NVIDIA GeForce RTX 4070

58.29 T

504 GB/s

#166

CPU
Intel Xeon w5-2545

57.75 T

153.60 GB/s

#167

GPU
11 GB
NVIDIA GeForce RTX 2080 Ti

56.92 T

616 GB/s

#168

CPU
Intel Xeon w5-3425

56.52 T

307.20 GB/s

#169

CPU
Intel Xeon w5-2455X

56.52 T

153.60 GB/s

#170

GPU
28 GB
AMD Radeon PRO V710

55.30 T

504 GB/s

#171

CPU
Intel Xeon Gold 6426Y

54.07 T

307.20 GB/s

#172

CPU
Intel Xeon Gold 6416H

53.45 T

307.20 GB/s

#173

CPU
Intel Xeon 6513P-B

53.25 T

179.20 GB/s

#174

CPU
Intel Xeon Platinum 8444H

52.43 T

307.20 GB/s

#175

GPU
12 GB
NVIDIA GeForce RTX 4080 Laptop

49.44 T

432 GB/s

#176

GPU
16 GB
NVIDIA GeForce RTX 5080 Laptop

49.15 T

896 GB/s

#177

CPU
Intel Xeon 6505P

47.92 T

409.60 GB/s

#178

CPU
Intel Xeon w5-2445

47.10 T

153.60 GB/s

#179

CPU
Intel Xeon w3-2535

47.10 T

140.80 GB/s

#180

GPU
8 GB
NVIDIA GeForce RTX 5070 Laptop

46.45 T

512 GB/s

#181

CPU
Intel Xeon Gold 6526Y

45.88 T

332.80 GB/s

#182

CPU
Intel Xeon Gold 5416S

45.88 T

281.60 GB/s

#183

GPU
16 GB
AMD Radeon RX 7600 XT

45.14 T

288 GB/s

#184

GPU
8 GB
NVIDIA GeForce RTX 2080 SUPER

44.61 T

495 GB/s

#185

GPU
8 GB
AMD Radeon RX 7650 GRE

44.15 T

288 GB/s

#186

GPU
16 GB
NVIDIA GeForce RTX 4060 Ti

44.13 T

288 GB/s

#187

GPU
8 GB
NVIDIA GeForce RTX 3070 Ti

43.50 T

608 GB/s

#188

GPU
8 GB
AMD Radeon RX 7600

43.50 T

288 GB/s

#189

CPU
Intel Xeon Silver 4514Y

42.60 T

281.60 GB/s

#190

GPU
8 GB
Intel Arc A570M

42.60 T

224 GB/s

#191

GPU
8 GB
AMD Radeon RX 7700S

40.96 T

288 GB/s

#192

GPU
8 GB
NVIDIA GeForce RTX 3070

40.63 T

448 GB/s

#193

CPU
Intel Xeon Silver 4510

40.55 T

281.60 GB/s

#194

GPU
8 GB
AMD Radeon RX 7600M XT

40.45 T

288 GB/s

#195

GPU
8 GB
NVIDIA GeForce RTX 2080

40.27 T

448 GB/s

#196

GPU
8 GB
AMD Radeon PRO W7600

39.98 T

288 GB/s

#197

GPU
8 GB
NVIDIA GeForce RTX 2080 SUPER Laptop

38.34 T

448 GB/s

#198

GPU
8 GB
NVIDIA GeForce RTX 3080 Laptop

37.97 T

448 GB/s

#199

GPU
16 GB
NVIDIA GeForce RTX 3080 Ti Laptop

37.42 T

512 GB/s

#200

CPU
Intel Xeon w3-2525

36.86 T

140.80 GB/s

#201

CPU
Intel Xeon w3-2435

36.86 T

140.80 GB/s

#202

GPU
8 GB
NVIDIA GeForce RTX 2070 SUPER

36.25 T

448 GB/s

#203

GPU
8 GB
NVIDIA GeForce RTX 5060 Laptop

36.13 T

512 GB/s

#204

CPU
Intel Xeon 6507P

35.23 T

409.60 GB/s

#205

CPU
Intel Xeon 6714P

35.23 T

409.60 GB/s

#206

CPU
Intel Xeon Silver 4410T

34.82 T

256 GB/s

#207

GPU
8 GB
AMD Radeon RX 7600M

34.55 T

256 GB/s

#208

CPU
Intel Xeon Silver 4410Y

34.41 T

256 GB/s

#209

CPU
Intel Xeon Silver 4510T

34.41 T

281.60 GB/s

#210

CPU
Intel Xeon Gold 6534

34.41 T

307.20 GB/s

#211

CPU
Intel Xeon Gold 6434H

33.59 T

307.20 GB/s

#212

GPU
6 GB
Intel Arc A380

33.59 T

185 GB/s

#213

CPU
Intel Xeon Gold 6434

33.59 T

307.20 GB/s

#214

GPU
4 GB
Intel Arc A370M

33.59 T

112 GB/s

#215

GPU
8 GB
NVIDIA GeForce RTX 3070 Ti Laptop

33.21 T

448 GB/s

#216

GPU
6 GB
Intel Arc A380M

32.77 T

185 GB/s

#217

GPU
8 GB
NVIDIA GeForce RTX 3060 Ti

32.39 T

448 GB/s

#218

CPU
Intel Xeon 6503P-B

31.95 T

153.60 GB/s

#219

GPU
8 GB
NVIDIA GeForce RTX 3070 Laptop

31.95 T

448 GB/s

#220

GPU
8 GB
Intel Arc A530M

31.95 T

224 GB/s

#221

GPU
8 GB
AMD Radeon RX 7600S

31.54 T

256 GB/s

#222

GPU
8 GB
NVIDIA GeForce RTX 4070 Laptop

31.24 T

256 GB/s

#223

GPU
8 GB
NVIDIA GeForce RTX 4060

30.23 T

272 GB/s

#224

GPU
8 GB
NVIDIA GeForce RTX 2070

29.86 T

448 GB/s

#225

CPU
Intel Xeon Gold 5415+

29.49 T

281.60 GB/s

#226

CPU
Intel Xeon Gold 5515+

29.49 T

307.20 GB/s

#227

CPU
Intel Xeon Silver 4509Y

29.49 T

281.60 GB/s

#228

GPU
8 GB
NVIDIA GeForce RTX 2060 SUPER

28.72 T

448 GB/s

#229

GPU
4 GB
Intel Arc A350M

27.03 T

112 GB/s

#230

CPU
Intel Xeon w3-2425

27.03 T

140.80 GB/s

#231

GPU
8 GB
NVIDIA GeForce RTX 2070 Laptop

26.54 T

448 GB/s

#232

GPU
6 GB
NVIDIA GeForce RTX 2060

25.80 T

336 GB/s

#233

CPU
Intel Xeon w3-2423

25.80 T

140.80 GB/s

#234

GPU
12 GB
NVIDIA GeForce RTX 3060

25.48 T

360 GB/s

#235

GPU
4 GB
Intel Arc A350

24.58 T

123 GB/s

#236

GPU
8 GB
AMD Radeon PRO W7500

24.37 T

172 GB/s

#237

GPU
8 GB
NVIDIA GeForce RTX 4060 Laptop

23.22 T

256 GB/s

#238

GPU
4 GB
Intel Arc A310

21.50 T

123 GB/s

#239

GPU
6 GB
NVIDIA GeForce RTX 2060 Laptop

18.43 T

336 GB/s

#240

GPU
8 GB
NVIDIA GeForce RTX 3050

18.20 T

224 GB/s

#241

CPU
Intel Xeon Bronze 3508U

18.02 T

281 GB/s

#242

GPU
6 GB
NVIDIA GeForce RTX 4050 Laptop

17.97 T

192 GB/s

#243

CPU
Intel Xeon Bronze 3408U

15.56 T

256 GB/s

#244

GPU
4 GB
NVIDIA GeForce RTX 3050 Ti Laptop

15.21 T

192 GB/s

#245

GPU
4 GB
NVIDIA GeForce RTX 3050 Laptop

11.00 T

192 GB/s

#246

GPU
4 GB
NVIDIA GeForce RTX 2050 Laptop

10.20 T

112 GB/s

#247

GPU
2 GB
NVIDIA GeForce MX570

9.46 T

96 GB/s