GPU

NVIDIA GeForce RTX 3070 Ti

Edit@4 months ago

Intergrated Memory(VRAM)
Capacity

8 GB

(GDDR6X 256-bit)

Bandwidth

608 GB/s

86 Token/s

Vector Compute
FP64
339.80 G
FP32
21.75 T
FP16
21.75 T
BF16
21.75 T
INT32
10.88 T
INT8
X

NVIDIA GeForce RTX 3070 Ti General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

FP64: 339.80 GFLOPS

FP32: 21.75 TFLOPS

FP16: 21.75 TFLOPS

BF16: 21.75 TFLOPS

INT32: 10.88 TOPS

Matirx Compute
FP64
X
FP32
X
FP16
43.50 T
87.00 T
FP8
X
TF32
21.75 T
43.50 T
BF16
43.50 T
87.00 T
INT16
X
INT8
174.00 T
348.00 T
INT4
348.00 T
695.99 T

NVIDIA GeForce RTX 3070 Ti AI performance (Tensor Performance / Matrix Performance)

FP16: 43.50 TFLOPS, with sparsity: 87.00 TFLOPS

TF32: 21.75 TFLOPS, with sparsity: 43.50 TFLOPS

BF16: 43.50 TFLOPS, with sparsity: 87.00 TFLOPS

INT8: 174.00 TOPS, with sparsity: 348.00 TOPS

INT4: 348.00 TOPS, with sparsity: 695.99 TOPS

Hardware Specs
NVIDIA GeForce RTX 3070 Ti is a 8nm chip, has 17400 million transistors, launched by NVIDIA at 2021. It has 8 GB built-in(On-Board/On-Chip) memory with bandwidth up to 608 GB/s. It has 6144 general-purpose ALUs(CUDA cores/Shader cores) and 192 matrix cores(Tensor cores) .
Process Node
8 nm
Launch Year
2021
Vector(CUDA) Cores
6144
Matrix(Tensor) Cores
192
Core Frequency
1575 ~ 1770 MHz
Cache
4MB