That’s interesting and it seems that maybe only the parameters were loaded? Although I would assume that this would raise an error, as you would have a shape mismatch in the last linear layer.
Note that I don’t use the C++ frontend for training, so I’m not sure how the serialization is working correctly and I usually just stick to the tests 5 to see a proper usage.
However, I cannot find a comparable test for the fine-tuning use case.
I think @yf225 would know, what’s going on.