Solved by ptrblck in post #2 
              
              
                You could try to filter out the wrongly shaped parameters from the state_dict and try to load it using strict=False afterwards.