Deep Learning, Machine Learning, Gpu, Cuda, AI.
Libraries like PyTorch and Tensorflow implement optimization techniques that involves other more complex concepts such as optimized memory access, batched operations and others (they harness libraries built on top of CUDA, such as cuBLAS and cuDNN). However, I hope this post helps clear up what