Since PyTorch is being improved continuously you can assume that the execution speed and memory footprint both will be improved in newer versions.
Regarding the two versions you are mentioning, it seems this PR improved the memory usage for large models greatly.
However, I’m not sure if you are using the GPU or run your code on CPU, since newer versions of CUDA/cuDNN etc. also play an important role here.