CPU

AMD EPYC 4564P

Edit@3 months ago

Socketed Memory
Capacity

192 GB

2 Channels xDDR5 5200MT/s

Bandwidth

83.2 GB/s

11 Token/s

Vector Compute
FP64
1.46 T
FP32
2.92 T
FP16
X
BF16
5.84 T
INT32
X
INT8
11.67 T
Theoretical peak performance: 16 Cores @ 5700 MHz with 256-bit AVX2 and Dual 128-bit FMAs (Support INT8, BF16)

AMD EPYC 4564P General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

FP64: 1.46 TFLOPS

FP32: 2.92 TFLOPS

BF16: 5.84 TFLOPS

INT8: 11.67 TOPS

Matirx Compute
No dedicated Tensor(Matrix) Units for AI

AMD EPYC 4564P AI performance (Tensor Performance / Matrix Performance)

Hardware Specs
AMD EPYC 4564P is a 5nm chip, launched by AMD at 2024. It has 16 cores, can run up to 32 threads.It can use DDR5 5200MT/s memory modules.It supports up to 2 memory channels with max bandwidth 83.2 GB/s and max capacity 0.19 GB.
Process Node
5 nm
Launch Year
2024
Max SMP
1
Cache
64MB
Threads
32
Num of Cores
16
Base Frequency
4500MHz
Boost Frequency
5700MHz
All Core Turbo Freq
Unknown
SIMD Extensions
SSE4.2
AVX
AVX2
AVX-512
FMA3