So I guess for this model, the peak memory usage increased between 1.2 and later versions.
I am not familiar with these models. Do you have a short description of its structure and the modules used? Or could you write a small nn.Module that looks similar (and reproduces the memory increase)?