CPU

AMD EPYC 9355P

Edit@3 months ago

Socketed Memory
Capacity

6 TB

12 Channels xDDR5 6000MT/s

Bandwidth

576 GB/s

82 Token/s

Vector Compute
FP64
4.51 T
FP32
9.01 T
FP16
X
BF16
18.02 T
INT32
X
INT8
36.05 T
Theoretical peak performance: 32 Cores @ 4400 MHz with 512-bit AVX512 and Single 512-bit FMA Unit(Support INT8, BF16)

AMD EPYC 9355P General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

FP64: 4.51 TFLOPS

FP32: 9.01 TFLOPS

BF16: 18.02 TFLOPS

INT8: 36.05 TOPS

Matirx Compute
No dedicated Tensor(Matrix) Units for AI

AMD EPYC 9355P AI performance (Tensor Performance / Matrix Performance)

Hardware Specs
AMD EPYC 9355P is a 4nm chip, launched by AMD at 2024. It has 32 cores, can run up to 64 threads.It can use DDR5 6000MT/s memory modules.It supports up to 12 memory channels with max bandwidth 576.0 GB/s and max capacity 6 GB.
Process Node
4 nm
Launch Year
2024
Max SMP
1
Cache
256MB
Threads
64
Num of Cores
32
Base Frequency
3550MHz
Boost Frequency
4400MHz
All Core Turbo Freq
Unknown
SIMD Extensions
SSE4.2
AVX
AVX2
AVX-512
FMA3