CPU

AMD Ryzen Threadripper 7960X

Edit@3 months ago

Socketed Memory
Capacity

1024 GB

4 Channels xDDR5 5200MT/s

Bandwidth

166.4 GB/s

23 Token/s

Vector Compute
FP64
2.04 T
FP32
4.07 T
FP16
X
BF16
8.14 T
INT32
X
INT8
16.28 T
Theoretical peak performance: 24 Cores @ 5300 MHz with 256-bit AVX2 and Dual 128-bit FMAs (Support INT8, BF16)

AMD Ryzen Threadripper 7960X General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

FP64: 2.04 TFLOPS

FP32: 4.07 TFLOPS

BF16: 8.14 TFLOPS

INT8: 16.28 TOPS

Matirx Compute
No dedicated Tensor(Matrix) Units for AI

AMD Ryzen Threadripper 7960X AI performance (Tensor Performance / Matrix Performance)

Hardware Specs
AMD Ryzen Threadripper 7960X is a 5nm chip, launched by AMD at 2023. It has 24 cores, can run up to 48 threads.It can use DDR5 5200MT/s memory modules.It supports up to 4 memory channels with max bandwidth 166.4 GB/s and max capacity 1 GB.
Process Node
5 nm
Launch Year
2023
Max SMP
1
Cache
128MB
Threads
48
Num of Cores
24
Base Frequency
4200MHz
Boost Frequency
5300MHz
All Core Turbo Freq
Unknown
SIMD Extensions
SSE4.2
AVX
AVX2
AVX-512
FMA3