Encyclopedia · 176 concepts

MLOps & Infrastructure · beginner · concept 132 of 176

GPU & TPU Computing

GPUs (NVIDIA) and TPUs (Google) are the hardware that makes deep learning possible. Their parallel processing capabilities accelerate matrix operations by 100x+ versus CPUs. This is the same lineage as high-performance computing: AI clusters are supercomputers, ranked and benchmarked as such.

Key terms

CUDATensor coresHBMAccelerator generations (Hopper, Blackwell, Rubin)TPUParallelismHPC & supercomputing

Courses, papers, and more