So I’m trying to train multiple (let’s say 10) models simultaneously on a single GPU. The way I’m trying to go about this is have a list of models, and optimizers. The models are stored on CPU, and I iterate through the model list, putting one model on the GPU, training for an epoch, and then putting the model back on CPU and moving to the next model on the list. The problem is, usually one of the models in the list has a very high loss value (nan sometimes). I’m wondering if there is some sort of leak happening?