GPU

NVIDIA GeForce RTX 4060

Edit@3 days ago

Intergrated Memory
Capacity

8 GB

(GDDR6 128-bit)

Bandwidth

272 GB/s

38 Token/s

Vector Compute
FP64
236.20 G
FP32
15.11 T
FP16
15.11 T
BF16
15.11 T
INT32
7.55 T
INT8
X

NVIDIA GeForce RTX 4060 General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

FP64: 236.20 GFLOPS

FP32: 15.11 TFLOPS

FP16: 15.11 TFLOPS

BF16: 15.11 TFLOPS

INT32: 7.55 TOPS

Matirx Compute
FP64
X
FP32
X
FP16
30.23 T
60.46 T
FP8
60.46 T
120.91 T
TF32
15.11 T
30.23 T
BF16
30.23 T
60.46 T
INT16
X
INT8
120.91 T
241.83 T
INT4
241.83 T
483.66 T

NVIDIA GeForce RTX 4060 AI performance (Tensor Performance / Matrix Performance)

FP16: 30.23 TFLOPS, with sparsity: 60.46 TFLOPS

FP8: 60.46 TFLOPS, with sparsity: 120.91 TFLOPS

TF32: 15.11 TFLOPS, with sparsity: 30.23 TFLOPS

BF16: 30.23 TFLOPS, with sparsity: 60.46 TFLOPS

INT8: 120.91 TOPS, with sparsity: 241.83 TOPS

INT4: 241.83 TOPS, with sparsity: 483.66 TOPS

Hardware Specs
NVIDIA GeForce RTX 4060 is a 5nm chip, has 18900 million transistors, launched by NVIDIA at 2023. It has 8 GB built-in(On-Board/On-Chip) memory with bandwidth up to 272 GB/s. It has 3072 general-purpose ALUs(CUDA cores/Shader cores) and 96 matrix cores(Tensor cores) .
Process Node
5 nm
Launch Year
2023
Vector(CUDA) Cores
3072
Matrix(Tensor) Cores
96
Core Frequency
1830 ~ 2460 MHz
Cache
24MB

Comment without registration

Share your experience with NVIDIA GeForce RTX 4060 / Found an Error? Help Us Improve!