GPU

NVIDIA GeForce RTX 4060 Laptop

Edit@4 months ago

Intergrated Memory(VRAM)
Capacity

8 GB

(GDDR6 128-bit)

Bandwidth

256 GB/s

36 Token/s

Vector Compute
FP64
181.40 G
FP32
11.61 T
FP16
11.61 T
BF16
11.61 T
INT32
5.80 T
INT8
X

NVIDIA GeForce RTX 4060 Laptop General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

FP64: 181.40 GFLOPS

FP32: 11.61 TFLOPS

FP16: 11.61 TFLOPS

BF16: 11.61 TFLOPS

INT32: 5.80 TOPS

Matirx Compute
FP64
X
FP32
X
FP16
23.22 T
46.45 T
FP8
46.45 T
92.90 T
TF32
11.61 T
23.22 T
BF16
23.22 T
46.45 T
INT16
X
INT8
92.90 T
185.79 T
INT4
185.79 T
371.59 T

NVIDIA GeForce RTX 4060 Laptop AI performance (Tensor Performance / Matrix Performance)

FP16: 23.22 TFLOPS, with sparsity: 46.45 TFLOPS

FP8: 46.45 TFLOPS, with sparsity: 92.90 TFLOPS

TF32: 11.61 TFLOPS, with sparsity: 23.22 TFLOPS

BF16: 23.22 TFLOPS, with sparsity: 46.45 TFLOPS

INT8: 92.90 TOPS, with sparsity: 185.79 TOPS

INT4: 185.79 TOPS, with sparsity: 371.59 TOPS

Hardware Specs
NVIDIA GeForce RTX 4060 Laptop is a 5nm chip, has 18900 million transistors, launched by NVIDIA at 2023. It has 8 GB built-in(On-Board/On-Chip) memory with bandwidth up to 256 GB/s. It has 3072 general-purpose ALUs(CUDA cores/Shader cores) and 96 matrix cores(Tensor cores) .
Process Node
5 nm
Launch Year
2023
Vector(CUDA) Cores
3072
Matrix(Tensor) Cores
96
Core Frequency
1545 ~ 1890 MHz
Cache
32MB