CPU

AMD EPYC 9354

Edit@2 months ago

Socketed Memory
Capacity

(12 t('channels'))

Bandwidth

460.8 GB/s

(DDR5 4800MT/s)

Vector Compute
FP64
1.95 T
FP32
3.89 T
FP16
X
BF16
7.78 T
INT32
X
INT8
15.56 T
Theoretical peak performance: 32 Cores @ 3800 MHz with 256-bit AVX2 and Dual 128-bit FMAs (Support INT8, BF16)

AMD EPYC 9354 General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

FP64: 1.95 TFLOPS

FP32: 3.89 TFLOPS

BF16: 7.78 TFLOPS

INT8: 15.56 TOPS

Matirx Compute
Not dedicated Tensor(Matrix) cores / Matrix instructions.

AMD EPYC 9354 AI performance (Tensor Performance / Matrix Performance)

Hardware Specs
AMD EPYC 9354 is a 5nm chip, launched by AMD at 2022. It has 32 cores, can run up to 64 threads.It can use DDR5 4800MT/s memory modules.It supports up to 12 memory channels with max bandwidth 460.8 GB/s.
Process Node
5 nm
Launch Year
2022

Max SMP
2
Cache
256MB
Threads
64

Num of Cores
32
Base Frequency
3250MHz
Boost Frequency
3800MHz
All Core Turbo Freq
Unknown

SIMD Extensions
SSE4.2
AVX
AVX2
AVX-512
FMA3

Comment without registration

Share your experience with AMD EPYC 9354 / Found an Error? Help Us Improve!