@SimonW I donot mean the GPU memory goes up after iterations’ running. As I manually release the GPU memory during training, so the GPU memory goes up and down during training, when my memory occupation is low, other users begin to run their codes, and then my program is killed because of memory issue. And that’s why I like to know if we can occupy all the memory or not at the beginning of training.