GPU

AMD Radeon RX 7900 XT

Edit@1 months ago

Intergrated Memory(VRAM)
Capacity

20 GB

(GDDR6 320-bit)

Bandwidth

800 GB/s

114 Token/s

Vector Compute
FP64
1.61 T
FP32
51.48 T
FP16
103 T
BF16
X
INT32
NI
INT8
X

AMD Radeon RX 7900 XT General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

FP64: 1.61 TFLOPS

FP32: 51.48 TFLOPS

FP16: 103 TFLOPS

Matirx Compute
FP64
X
FP32
X
FP16
102.96 T
FP8
X
TF32
X
BF16
102.96 T
INT16
X
INT8
102.96 T
INT4
205.92 T

AMD Radeon RX 7900 XT AI performance (Tensor Performance / Matrix Performance)

FP16: 102.96 TFLOPS

BF16: 102.96 TFLOPS

INT8: 102.96 TOPS

INT4: 205.92 TOPS

Hardware Specs
AMD Radeon RX 7900 XT is a 5nm chip, has 57700 million transistors, launched by AMD at 2022. It has 20 GB built-in(On-Board/On-Chip) memory with bandwidth up to 800 GB/s. It has 5376 general-purpose ALUs(CUDA cores/Shader cores) and 168 matrix cores(Tensor cores) .
Process Node
5 nm
Launch Year
2022
Vector(CUDA) Cores
5376
Matrix(Tensor) Cores
168
Core Frequency
1387 ~ 2394 MHz
Cache
80MB