Pytorch, Deep Learning, Optimization, Tensorboard, Deep Dives.
the image below. Although it continues to indicate opportunity for further improvement, with just one line of code the utilization jumped from 0% to 26.3%. Tensor Core Utilization with AMP optimization from Kernel View in TensorBoard Profiler (Captured by Author) In addition to increasing Tensor