Hi @ptrblck, thank you for the reply. I discovered that I was only setting the weights upon instantiation but I also needed to set the biases by adding these lines:
        self.pre_classifier.bias.data.copy_(pre_classifier_init.bias.data)
        self.classifier.bias.data.copy_(classifier_init.bias.data)

With these lines, my results become deterministic.