Most likely you just see some effects of different parameter initializations.
Since the modules were initialized in __init__, the random number generator was called, thus sampled other values for all following modules.
Even if you set a seed, you’ll see the effect.
Could you remove the unused modules, run the experiment for a few different seeds, and compare the results?