GPU

NVIDIA GeForce RTX 4080 Laptop

Edit@4 months ago

Intergrated Memory(VRAM)
Capacity

12 GB

(GDDR6 192-bit)

Bandwidth

432 GB/s

61 Token/s

Vector Compute
FP64
386.30 G
FP32
24.72 T
FP16
24.72 T
BF16
24.72 T
INT32
12.36 T
INT8
X

NVIDIA GeForce RTX 4080 Laptop General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

FP64: 386.30 GFLOPS

FP32: 24.72 TFLOPS

FP16: 24.72 TFLOPS

BF16: 24.72 TFLOPS

INT32: 12.36 TOPS

Matirx Compute
FP64
X
FP32
X
FP16
49.44 T
98.89 T
FP8
98.89 T
197.78 T
TF32
24.72 T
49.44 T
BF16
49.44 T
98.89 T
INT16
X
INT8
197.78 T
395.55 T
INT4
395.55 T
791.10 T

NVIDIA GeForce RTX 4080 Laptop AI performance (Tensor Performance / Matrix Performance)

FP16: 49.44 TFLOPS, with sparsity: 98.89 TFLOPS

FP8: 98.89 TFLOPS, with sparsity: 197.78 TFLOPS

TF32: 24.72 TFLOPS, with sparsity: 49.44 TFLOPS

BF16: 49.44 TFLOPS, with sparsity: 98.89 TFLOPS

INT8: 197.78 TOPS, with sparsity: 395.55 TOPS

INT4: 395.55 TOPS, with sparsity: 791.10 TOPS

Hardware Specs
NVIDIA GeForce RTX 4080 Laptop is a 5nm chip, has 35800 million transistors, launched by NVIDIA at 2023. It has 12 GB built-in(On-Board/On-Chip) memory with bandwidth up to 432 GB/s. It has 7424 general-purpose ALUs(CUDA cores/Shader cores) and 232 matrix cores(Tensor cores) .
Process Node
5 nm
Launch Year
2023
Vector(CUDA) Cores
7424
Matrix(Tensor) Cores
232
Core Frequency
1290 ~ 1665 MHz
Cache
48MB