CPU

AMD EPYC 9754

Edit@3 months ago

Socketed Memory
Capacity

6 TB

12 Channels xDDR5 4800MT/s

Bandwidth

460.8 GB/s

65 Token/s

Vector Compute
FP64
6.35 T
FP32
12.70 T
FP16
X
BF16
25.39 T
INT32
X
INT8
50.79 T
Theoretical peak performance: 128 Cores @ 3100 MHz with 256-bit AVX2 and Dual 128-bit FMAs (Support INT8, BF16)

AMD EPYC 9754 General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

FP64: 6.35 TFLOPS

FP32: 12.70 TFLOPS

BF16: 25.39 TFLOPS

INT8: 50.79 TOPS

Matirx Compute
No dedicated Tensor(Matrix) Units for AI

AMD EPYC 9754 AI performance (Tensor Performance / Matrix Performance)

Hardware Specs
AMD EPYC 9754 is a 5nm chip, launched by AMD at 2023. It has 128 cores, can run up to 256 threads.It can use DDR5 4800MT/s memory modules.It supports up to 12 memory channels with max bandwidth 460.8 GB/s and max capacity 6 GB.
Process Node
5 nm
Launch Year
2023
Max SMP
2
Cache
256MB
Threads
256
Num of Cores
128
Base Frequency
2250MHz
Boost Frequency
3100MHz
All Core Turbo Freq
Unknown
SIMD Extensions
SSE4.2
AVX
AVX2
AVX-512
FMA3