Solved by LeviViana in post #2 
              
              
                Yes, it is ok to do that. You could even do something like : small_decoders[model_name] = model.state_dict(), so that you can serialize small_decoders for later use (using JSON or Pickle).