CPU

Intel Xeon Silver 4410T

Edit@3 months ago

Socketed Memory
Capacity

4 TB

8 Channels xDDR5 4000MT/s

Bandwidth

256 GB/s

36 Token/s

Vector Compute
FP64
1.09 T
FP32
2.18 T
FP16
4.35 T
BF16
4.35 T
INT32
X
INT8
8.70 T
Theoretical peak performance: 10 Cores @ 3400 MHz with 512-bit AVX512 and Dual 512-bit FMAs (Support INT8, BF16, FP16)

Intel Xeon Silver 4410T General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

FP64: 1.09 TFLOPS

FP32: 2.18 TFLOPS

FP16: 4.35 TFLOPS

BF16: 4.35 TFLOPS

INT8: 8.70 TOPS

Matirx Compute
FP64
X
FP32
X
FP16
34.82 T
FP8
X
TF32
X
BF16
34.82 T
INT16
X
INT8
69.63 T
INT4
X
Theoretical peak performance: 10 Cores @ 3400 MHz with Intel Advanced Matrix Extensions

Intel Xeon Silver 4410T AI performance (Tensor Performance / Matrix Performance)

FP16: 34.82 TFLOPS

BF16: 34.82 TFLOPS

INT8: 69.63 TOPS

Hardware Specs
Intel Xeon Silver 4410T is a 10nm chip, launched by Intel at 2023. It has 10 cores, can run up to 20 threads.It can use DDR5 4000MT/s memory modules.It supports up to 8 memory channels with max bandwidth 256.0 GB/s and max capacity 4 GB.
Process Node
10 nm
Launch Year
2023
Max SMP
2
Cache
26.25MB
Threads
20
Num of Cores
10
Base Frequency
2700MHz
Boost Frequency
4000MHz
All Core Turbo Freq
3400MHz
SIMD Extensions
SSE4.2
AVX
AVX2
AVX-512
FMA3
AMX