CPU

Intel Xeon Gold 5318H

Edit@3 months ago

Socketed Memory
Capacity

1.50 TB

6 Channels xDDR4 2667MT/s

Bandwidth

128.016 GB/s

18 Token/s

Vector Compute
FP64
2.19 T
FP32
4.38 T
FP16
X
BF16
8.76 T
INT32
X
INT8
17.51 T
Theoretical peak performance: 18 Cores @ 3800 MHz with 512-bit AVX512 and Single 512-bit FMA Unit(Support INT8, BF16)

Intel Xeon Gold 5318H General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

FP64: 2.19 TFLOPS

FP32: 4.38 TFLOPS

BF16: 8.76 TFLOPS

INT8: 17.51 TOPS

Matirx Compute
No dedicated Tensor(Matrix) Units for AI

Intel Xeon Gold 5318H AI performance (Tensor Performance / Matrix Performance)

Hardware Specs
Intel Xeon Gold 5318H is a 14nm chip, launched by Intel at 2021. It has 18 cores, can run up to 36 threads.It can use DDR4 2667MT/s memory modules.It supports up to 6 memory channels with max bandwidth 128.016 GB/s and max capacity 1.5 GB.
Process Node
14 nm
Launch Year
2021
Max SMP
4
Cache
24.75MB
Threads
36
Num of Cores
18
Base Frequency
2500MHz
Boost Frequency
3800MHz
All Core Turbo Freq
Unknown
SIMD Extensions
SSE4.2
AVX
AVX2
AVX-512
FMA3