I tried that but the memory still increases.
Actually, even if I comment out
u = Variable(batch['u'])
i = Variable(batch['i'])
j = Variable(batch['j'])

the above code, the memory still increases.
This makes me pretty sure that the problem comes from DataLoader