What kind of data is the network working with here?
From my experience Setting the relu inplace to true modifies the input features inplace rather than allocate new memory to a copy of the input and also autograd doesn’t really work well with relu Inplace = True so I don’t see any issues here can u pls upload ur training process too