CPU

Intel Xeon Gold 6416H

Name: Intel Xeon Gold 6416H
Brand: Intel

Edit@11 months ago

可扩展插槽内存

容量

4 TB

8 通道 xDDR5 4800MT/s

带宽

307.2 GB/s

43 Token/s

向量计算

FP64

1.67 T

FP32

3.34 T

FP16

6.68 T

BF16

6.68 T

INT32

X

INT8

13.36 T

Theoretical peak performance: 18 Cores @ 2900 MHz with 512-bit AVX512 and Dual 512-bit FMAs (Support INT8, BF16, FP16)

Intel Xeon Gold 6416H General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

FP64: 1.67 TFLOPS

FP32: 3.34 TFLOPS

FP16: 6.68 TFLOPS

BF16: 6.68 TFLOPS

INT8: 13.36 TOPS

矩阵计算

FP64

X

FP32

X

FP16

53.45 T

FP8

X

TF32

X

BF16

53.45 T

INT16

X

INT8

106.91 T

INT4

X

Theoretical peak performance: 18 Cores @ 2900 MHz with Intel Advanced Matrix Extensions

Intel Xeon Gold 6416H AI performance (Tensor Performance / Matrix Performance)

FP16: 53.45 TFLOPS

BF16: 53.45 TFLOPS

INT8: 106.91 TOPS

一般参数

Intel Xeon Gold 6416H is a 10nm chip, launched by Intel at 2023. It has 18 cores, can run up to 36 threads.It can use DDR5 4800MT/s memory modules.It supports up to 8 memory channels with max bandwidth 307.2 GB/s and max capacity 4 GB.

Intel Xeon Gold 6416H

可扩展插槽内存

容量

4 TB

带宽

307.2 GB/s

向量计算

FP64

1.67 T

FP32

3.34 T

FP16

6.68 T

BF16

6.68 T

INT32

X

INT8

13.36 T

Intel Xeon Gold 6416H General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

矩阵计算

FP64

X

FP32

X

FP16

53.45 T

FP8

X

TF32

X

BF16

53.45 T

INT16

X

INT8

106.91 T

INT4

X

Intel Xeon Gold 6416H AI performance (Tensor Performance / Matrix Performance)

一般参数

制程工艺

10 nm

发布年份

2023

Max SMP

4

缓存

45MB

线程数

36

核心总数

18

基础频率

2200MHz

睿频频率

4200MHz

全核频率

2900MHz

SIMD指令集