Thanks that really explains things!
Why though?? Isn’t the point of feature visualization to understand how the weights behave for an image? In my case, it seems that the noise is dominating and more or less the only thing I see is something related to this noise. The feature maps are always completely unrelated to the previous iteration.
Am I misunderstanding something here, why would you want this? Can I turn the noise completely off?
Edit: I remembered something and found out that I already do this!
torch.manual_seed(42)