Ah yes that makes sense @mMagmer. Thanks.
But why does it give better estimation to zero it after 10 batch? Won’t the batch after it is set to zero be a bad estimation then?
And a second question:



 mMagmer:

If you are initializing weight for Cross Entropy with proportion to 1 over class prior (1/p_i) for each class, then you’re minimizing average recall over all class.
and accuracy is good estimation of average recall if you have plenty of data. If not, you should calculate average recall.


I initialize it like this and set balance as parameter. Should I then consider the dataset balanced?