GPU

NVIDIA GeForce RTX 4050 Laptop

Edit@4 months ago

Intergrated Memory(VRAM)
Capacity

6 GB

(GDDR6 96-bit)

Bandwidth

192 GB/s

Out of Memory Token/s

Vector Compute
FP64
140.40 G
FP32
8.99 T
FP16
8.99 T
BF16
8.99 T
INT32
4.49 T
INT8
X

NVIDIA GeForce RTX 4050 Laptop General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

FP64: 140.40 GFLOPS

FP32: 8.99 TFLOPS

FP16: 8.99 TFLOPS

BF16: 8.99 TFLOPS

INT32: 4.49 TOPS

Matirx Compute
FP64
X
FP32
X
FP16
17.97 T
35.94 T
FP8
35.94 T
71.88 T
TF32
8.99 T
17.97 T
BF16
17.97 T
35.94 T
INT16
X
INT8
71.88 T
143.77 T
INT4
143.77 T
287.54 T

NVIDIA GeForce RTX 4050 Laptop AI performance (Tensor Performance / Matrix Performance)

FP16: 17.97 TFLOPS, with sparsity: 35.94 TFLOPS

FP8: 35.94 TFLOPS, with sparsity: 71.88 TFLOPS

TF32: 8.99 TFLOPS, with sparsity: 17.97 TFLOPS

BF16: 17.97 TFLOPS, with sparsity: 35.94 TFLOPS

INT8: 71.88 TOPS, with sparsity: 143.77 TOPS

INT4: 143.77 TOPS, with sparsity: 287.54 TOPS

Hardware Specs
NVIDIA GeForce RTX 4050 Laptop is a 5nm chip, has 18900 million transistors, launched by NVIDIA at 2023. It has 6 GB built-in(On-Board/On-Chip) memory with bandwidth up to 192 GB/s. It has 2560 general-purpose ALUs(CUDA cores/Shader cores) and 80 matrix cores(Tensor cores) .
Process Node
5 nm
Launch Year
2023
Vector(CUDA) Cores
2560
Matrix(Tensor) Cores
80
Core Frequency
1455 ~ 1755 MHz
Cache
12MB