Hi, when you say “holes” do you mean zeros?   You could try increasing the precision of your values (maybe the numbers get so small pytorch thinks they are zero).
Are you sure you need 46 hidden layers?   Seems rather a lot.
What are you passing to your eval_fn?   How are you splitting your train/eval data?
Could you be overfitting to your training data?