GPU

NVIDIA Tesla T4

Edit@1 months ago

Intergrated Memory(VRAM)
Capacity

16 GB

(GDDR6 256-bit)

Bandwidth

320 GB/s

45 Token/s

Vector Compute
FP64
254.40 G
FP32
8.14 T
FP16
65.13 T
BF16
X
INT32
NI
INT8
X

NVIDIA Tesla T4 General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

FP64: 254.40 GFLOPS

FP32: 8.14 TFLOPS

FP16: 65.13 TFLOPS

Matirx Compute
FP64
X
FP32
X
FP16
65.13 T
FP8
X
TF32
X
BF16
X
INT16
X
INT8
130.25 T
INT4
260.51 T

NVIDIA Tesla T4 AI performance (Tensor Performance / Matrix Performance)

FP16: 65.13 TFLOPS

INT8: 130.25 TOPS

INT4: 260.51 TOPS

Hardware Specs
NVIDIA Tesla T4 is a 12nm chip, has 13600 million transistors, launched by NVIDIA at 2018. It has 16 GB built-in(On-Board/On-Chip) memory with bandwidth up to 320 GB/s. It has 2560 general-purpose ALUs(CUDA cores/Shader cores) and 320 matrix cores(Tensor cores) .
Process Node
12 nm
Launch Year
2018
Vector(CUDA) Cores
2560
Matrix(Tensor) Cores
320
Core Frequency
585 ~ 1590 MHz
Cache
4MB

Comment without registration

Share your experience with NVIDIA Tesla T4 / Found an Error? Help Us Improve!