I was told to either


decrease the tensors dimension, then increase the tensors dimension again or

increase the tensors dimensions and then use depth-wise convolution or
use mixed-precision training

I know I can use https://github.com/NVIDIA/apex for the mixed precision training.
However, I am not sure how to modify the code for suggestions 1 and 2 above.