Interesting topics might be:

What's the difference between those two simple nn models? 2
Unused model parameters affect optimization for Adam 2
Problem using torch.manual_seed 2

You would have to avoid calling into random methods (not possible when randomly initializing new layers) or (re-)seed the code after initializing the model so that the training loop is directly seeded.