Thanks for providing the information. That is weird. Assuming input dim and batch dim is not too big, this shouldn’t happen. Are you able to run one iteration? Or is the memory usage increasing each iteration?