Hello all,
I am working on a depth estimation model. I have extended this model with a discriminator as in https://arxiv.org/pdf/1611.07004.pdf 1. Now I get “Warning: NaN or Inf found in input tensor” all the time while training. I wonder if this has a negative effect on my training and what I can do about it, does anyone have any ideas or tips?
The generator uses a pre-trained model and the discriminator is randomly initialized. I will now still initialize the weights as in the paper with the normal distribution. If that doesn’t help, my idea was to pre-train the discriminator and then later train everything in the composite.
I would be very grateful for any suggestions or ideas.