Solved by Felix_Labelle in post #3 
              
              
                The dimensions are the same, however the pretrained embedding vocab size is  ~4x larger (400,000 vs 100,000). Does Pytorch update the entire embedding at once? Otherwise I don’t see how having a larger embedding could be an issue (a side from having more memory consumed, but what I was seeing seemed…