CPU

Intel Xeon Silver 4516Y+

Edit@3 months ago

Socketed Memory
Capacity

3.91 TB

8 Channels xDDR5 4400MT/s

Bandwidth

281.6 GB/s

40 Token/s

Vector Compute
FP64
2.23 T
FP32
4.45 T
FP16
8.91 T
BF16
8.91 T
INT32
X
INT8
17.82 T
Theoretical peak performance: 24 Cores @ 2900 MHz with 512-bit AVX512 and Dual 512-bit FMAs (Support INT8, BF16, FP16)

Intel Xeon Silver 4516Y+ General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

FP64: 2.23 TFLOPS

FP32: 4.45 TFLOPS

FP16: 8.91 TFLOPS

BF16: 8.91 TFLOPS

INT8: 17.82 TOPS

Matirx Compute
FP64
X
FP32
X
FP16
71.27 T
FP8
X
TF32
X
BF16
71.27 T
INT16
X
INT8
142.54 T
INT4
X
Theoretical peak performance: 24 Cores @ 2900 MHz with Intel Advanced Matrix Extensions

Intel Xeon Silver 4516Y+ AI performance (Tensor Performance / Matrix Performance)

FP16: 71.27 TFLOPS

BF16: 71.27 TFLOPS

INT8: 142.54 TOPS

Hardware Specs
Intel Xeon Silver 4516Y+ is a 10nm chip, launched by Intel at 2023. It has 24 cores, can run up to 48 threads.It can use DDR5 4400MT/s memory modules.It supports up to 8 memory channels with max bandwidth 281.6 GB/s and max capacity 3.91 GB.
Process Node
10 nm
Launch Year
2023
Max SMP
2
Cache
45MB
Threads
48
Num of Cores
24
Base Frequency
2200MHz
Boost Frequency
3700MHz
All Core Turbo Freq
2900MHz
SIMD Extensions
SSE4.2
AVX
AVX2
AVX-512
FMA3
AMX