CPU

AMD EPYC 8324PN

Edit@3 months ago

Socketed Memory
Capacity

1.13 TB

6 Channels xDDR5 4800MT/s

Bandwidth

230.4 GB/s

32 Token/s

Vector Compute
FP64
1.54 T
FP32
3.07 T
FP16
X
BF16
6.14 T
INT32
X
INT8
12.29 T
Theoretical peak performance: 32 Cores @ 3000 MHz with 256-bit AVX2 and Dual 128-bit FMAs (Support INT8, BF16)

AMD EPYC 8324PN General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

FP64: 1.54 TFLOPS

FP32: 3.07 TFLOPS

BF16: 6.14 TFLOPS

INT8: 12.29 TOPS

Matirx Compute
No dedicated Tensor(Matrix) Units for AI

AMD EPYC 8324PN AI performance (Tensor Performance / Matrix Performance)

Hardware Specs
AMD EPYC 8324PN is a 5nm chip, launched by AMD at 2023. It has 32 cores, can run up to 64 threads.It can use DDR5 4800MT/s memory modules.It supports up to 6 memory channels with max bandwidth 230.4 GB/s and max capacity 1.12 GB.
Process Node
5 nm
Launch Year
2023
Max SMP
1
Cache
128MB
Threads
64
Num of Cores
32
Base Frequency
2050MHz
Boost Frequency
3000MHz
All Core Turbo Freq
Unknown
SIMD Extensions
SSE4.2
AVX
AVX2
AVX-512
FMA3