https://arxiv.org/abs/1706.06873 26
In ICML 2017 an interesting paper was introduced. Memory efficient convolution MEC suggests a new way to compute convolution with much lesser memory and much faster performance.
I think this is worth to implement in PyTorch.