CPU

Intel Xeon Platinum 8358P

Edit@3 months ago

Socketed Memory
Capacity

6 TB

8 Channels xDDR4 3200MT/s

Bandwidth

204.8 GB/s

29 Token/s

Vector Compute
FP64
3.48 T
FP32
6.96 T
FP16
X
BF16
X
INT32
X
INT8
27.85 T
Theoretical peak performance: 32 Cores @ 3400 MHz with 512-bit AVX512 and Dual 512-bit FMAs (Support INT8)

Intel Xeon Platinum 8358P General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

FP64: 3.48 TFLOPS

FP32: 6.96 TFLOPS

INT8: 27.85 TOPS

Matirx Compute
No dedicated Tensor(Matrix) Units for AI

Intel Xeon Platinum 8358P AI performance (Tensor Performance / Matrix Performance)

Hardware Specs
Intel Xeon Platinum 8358P is a 10nm chip, launched by Intel at 2021. It has 32 cores, can run up to 64 threads.It can use DDR4 3200MT/s memory modules.It supports up to 8 memory channels with max bandwidth 204.8 GB/s and max capacity 6 GB.
Process Node
10 nm
Launch Year
2021
Max SMP
2
Cache
48MB
Threads
64
Num of Cores
32
Base Frequency
2600MHz
Boost Frequency
3400MHz
All Core Turbo Freq
Unknown
SIMD Extensions
SSE4.2
AVX
AVX2
AVX-512
FMA3