GPU

AMD Radeon PRO W7900

Edit@4 months ago

Intergrated Memory(VRAM)
Capacity

48 GB

(GDDR6 384-bit)

Bandwidth

864 GB/s

123 Token/s

Vector Compute
FP64
1.92 T
FP32
61.32 T
FP16
122.60 T
BF16
X
INT32
NI
INT8
X

AMD Radeon PRO W7900 General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

FP64: 1.92 TFLOPS

FP32: 61.32 TFLOPS

FP16: 122.60 TFLOPS

Matirx Compute
FP64
X
FP32
X
FP16
122.63 T
FP8
X
TF32
X
BF16
122.63 T
INT16
X
INT8
122.63 T
INT4
245.27 T

AMD Radeon PRO W7900 AI performance (Tensor Performance / Matrix Performance)

FP16: 122.63 TFLOPS

BF16: 122.63 TFLOPS

INT8: 122.63 TOPS

INT4: 245.27 TOPS

Hardware Specs
AMD Radeon PRO W7900 is a 5nm chip, has 57700 million transistors, launched by AMD at 2023. It has 48 GB built-in(On-Board/On-Chip) memory with bandwidth up to 864 GB/s. It has 6144 general-purpose ALUs(CUDA cores/Shader cores) and 192 matrix cores(Tensor cores) .
Process Node
5 nm
Launch Year
2023
Vector(CUDA) Cores
6144
Matrix(Tensor) Cores
192
Core Frequency
1855 ~ 2495 MHz
Cache
96MB