yeah ,i seeing the OOM issue in the first iteration(s) , This error occurred at optimizer.step().and i storing the loss:(but the issue remains)
score = model(input)
loss = criterion(score,target) 
running_loss = loss.item()
loss.backward()
optimizer.step()  #optimizer = t.optim.Adam(model.parameters(),lr = lr)

I found this error because score = model(input). So should I add torch.utils.checkpoint into the model?