GPU

Apple M1 Pro GPU(14 cores)

Edit@1 months ago

Intergrated Memory(UMA)
Max Capacity

24 GB

( 2/3 of 36 GB UMA memory as VRAM )
Bandwidth

204 GB/s

29 Token/s

Vector Compute
FP64
2.32 T
FP32
4.64 T
FP16
9.29 T
BF16
X
INT32
NI
INT8
X

Apple M1 Pro GPU(14 cores) General-Purpose Float-Point performance (Vector Performance / Scalar Performance)

FP64: 2.32 TFLOPS

FP32: 4.64 TFLOPS

FP16: 9.29 TFLOPS

Matirx Compute
FP64
X
FP32
X
FP16
X
FP8
X
TF32
X
BF16
X
INT16
X
INT8
X
INT4
X

Apple M1 Pro GPU(14 cores) AI performance (Tensor Performance / Matrix Performance)

Hardware Specs
Apple M1 Pro GPU(14 cores) is a 5nm chip, launched by Apple at 2020. It has 24 GB built-in(On-Board/On-Chip) memory with bandwidth up to 204 GB/s. It has 1792 general-purpose ALUs(CUDA cores/Shader cores).
Process Node
5 nm
Launch Year
2020
Vector(CUDA) Cores
1792
Matrix(Tensor) Cores
Core Frequency
389 ~ 1296 MHz
Cache
MB