Depending on your setup and in particular if you are using cudnn.benchmark other kernels with a different memory requirement might be picked. Could you post a minimal executable code snippet as well as the used device, which would show the difference in memory usage, please?