Computer Hardware, TensorFlow, Nvidia, Linear Algebra, Gpu.
by one of the following three factors; memory bandwidth, math bandwidth and latency. In cases of insufficient parallelism, latency will be the greatest limiting factor. If there is sufficient parallelism, math or memory will be the greatest limiting factor, based on specific arithmetic intensity of