CPU

Intel Xeon 6960P

Edit@3 months ago

Socketed Memory
Capacity

3 TB

12 Channels xDDR5 6400MT/sMRDIMM 8800MT/s

Bandwidth

844.8 GB/s

120 Token/s

Vector Compute
FP64
8.76 T
FP32
17.51 T
FP16
35.02 T
BF16
35.02 T
INT32
X
INT8
70.04 T
Theoretical peak performance: 72 Cores @ 3800 MHz with 512-bit AVX512 and Dual 512-bit FMAs (Support INT8, BF16, FP16)

Intel Xeon 6960P General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

FP64: 8.76 TFLOPS

FP32: 17.51 TFLOPS

FP16: 35.02 TFLOPS

BF16: 35.02 TFLOPS

INT8: 70.04 TOPS

Matirx Compute
FP64
X
FP32
X
FP16
280.17 T
FP8
X
TF32
X
BF16
280.17 T
INT16
X
INT8
560.33 T
INT4
X
Theoretical peak performance: 72 Cores @ 3800 MHz with Intel Advanced Matrix Extensions

Intel Xeon 6960P AI performance (Tensor Performance / Matrix Performance)

FP16: 280.17 TFLOPS

BF16: 280.17 TFLOPS

INT8: 560.33 TOPS

Hardware Specs
Intel Xeon 6960P is a 5nm chip, launched by Intel at 2024. It has 72 cores, can run up to 144 threads.It can use DDR5 6400MT/s/MRDIMM 8800MT/s memory modules.It supports up to 12 memory channels with max bandwidth 844.8 GB/s and max capacity 3 GB.
Process Node
5 nm
Launch Year
2024
Max SMP
2
Cache
432MB
Threads
144
Num of Cores
72
Base Frequency
2700MHz
Boost Frequency
3900MHz
All Core Turbo Freq
3800MHz
SIMD Extensions
SSE4.2
AVX
AVX2
AVX-512
FMA3
AMX