Solved by Manuel_Alejandro_Dia in post #4 
              
              
                This is what I suspected was going to be the answer. 
You could carefully go through all of your code (or at least the parts where the model gets used), because if this happens: 

It means that the model is being wrapped into the DataParallel class before, and I don’t know if wrapping it twice will…