Yeah they are. What’s weird is that if i replace it to the snippet below, I still get the issue of gradients not flowing.
I measure by having labels to compare and using BCELoss. I tried just all 1’s but still face this issue.
d_rep = x[0:100,:] 
d_rep = x[300:400,:]