I apologize for the umbiguities. In fact, I am having problems during both training and testing.
(1)  Due to the reason that I am using a pre-learned modal, my practice is that I first ran in the evaluation mode (with some probing data) before training started to check for the initial performance.
(2)  I found that the GPU memory allocated for evaluation couldn’t be cleared (about 4G memory being occupied as illustated in the figure). This causes the memory shortage issue during training even if I set the batch size to only 16.
(3)  I am wondering if the the pre-allocated memory for the evaluation mode can be cleared for training purposes?