CPU

Intel Xeon w7-2475X

Edit@3 months ago

Socketed Memory
Capacity

2 TB

4 Channels xDDR5 4800MT/s

Bandwidth

153.6 GB/s

21 Token/s

Vector Compute
FP64
3.07 T
FP32
6.14 T
FP16
12.29 T
BF16
12.29 T
INT32
X
INT8
24.58 T
Theoretical peak performance: 20 Cores @ 4800 MHz with 512-bit AVX512 and Dual 512-bit FMAs (Support INT8, BF16, FP16)

Intel Xeon w7-2475X General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

FP64: 3.07 TFLOPS

FP32: 6.14 TFLOPS

FP16: 12.29 TFLOPS

BF16: 12.29 TFLOPS

INT8: 24.58 TOPS

Matirx Compute
FP64
X
FP32
X
FP16
98.30 T
FP8
X
TF32
X
BF16
98.30 T
INT16
X
INT8
196.61 T
INT4
X
Theoretical peak performance: 20 Cores @ 4800 MHz with Intel Advanced Matrix Extensions

Intel Xeon w7-2475X AI performance (Tensor Performance / Matrix Performance)

FP16: 98.30 TFLOPS

BF16: 98.30 TFLOPS

INT8: 196.61 TOPS

Hardware Specs
Intel Xeon w7-2475X is a 10nm chip, launched by Intel at 2023. It has 20 cores, can run up to 40 threads.It can use DDR5 4800MT/s memory modules.It supports up to 4 memory channels with max bandwidth 153.6 GB/s and max capacity 2 GB.
Process Node
10 nm
Launch Year
2023
Max SMP
1
Cache
37.5MB
Threads
40
Num of Cores
20
Base Frequency
2600MHz
Boost Frequency
4800MHz
All Core Turbo Freq
Unknown
SIMD Extensions
SSE4.2
AVX
AVX2
AVX-512
FMA3
AMX