GPU

NVIDIA GeForce RTX 4070 Laptop

Edit@4 months ago

Intergrated Memory(VRAM)
Capacity

8 GB

(GDDR6 128-bit)

Bandwidth

256 GB/s

36 Token/s

Vector Compute
FP64
244.10 G
FP32
15.62 T
FP16
15.62 T
BF16
15.62 T
INT32
7.81 T
INT8
X

NVIDIA GeForce RTX 4070 Laptop General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

FP64: 244.10 GFLOPS

FP32: 15.62 TFLOPS

FP16: 15.62 TFLOPS

BF16: 15.62 TFLOPS

INT32: 7.81 TOPS

Matirx Compute
FP64
X
FP32
X
FP16
31.24 T
62.48 T
FP8
62.48 T
124.97 T
TF32
15.62 T
31.24 T
BF16
31.24 T
62.48 T
INT16
X
INT8
124.97 T
249.94 T
INT4
249.94 T
499.88 T

NVIDIA GeForce RTX 4070 Laptop AI performance (Tensor Performance / Matrix Performance)

FP16: 31.24 TFLOPS, with sparsity: 62.48 TFLOPS

FP8: 62.48 TFLOPS, with sparsity: 124.97 TFLOPS

TF32: 15.62 TFLOPS, with sparsity: 31.24 TFLOPS

BF16: 31.24 TFLOPS, with sparsity: 62.48 TFLOPS

INT8: 124.97 TOPS, with sparsity: 249.94 TOPS

INT4: 249.94 TOPS, with sparsity: 499.88 TOPS

Hardware Specs
NVIDIA GeForce RTX 4070 Laptop is a 5nm chip, has 22900 million transistors, launched by NVIDIA at 2023. It has 8 GB built-in(On-Board/On-Chip) memory with bandwidth up to 256 GB/s. It has 4608 general-purpose ALUs(CUDA cores/Shader cores) and 144 matrix cores(Tensor cores) .
Process Node
5 nm
Launch Year
2023
Vector(CUDA) Cores
4608
Matrix(Tensor) Cores
144
Core Frequency
1395 ~ 1695 MHz
Cache
32MB