The autograd should clean the memory maybe you can refer to this issue

  
      github.com/pytorch/fairseq
  
  
    



Issue: memory increase in every batch that  lead to out memory in some epoch


	
	opened by mjc14
	on 2018-07-27
	
	
	closed by myleott
	on 2018-11-04
	


i use the this code to train a model , i find the memory which is increasing in every batch. that...