Thank you @smth!
By class-balancing, did you mean some non-random sampling in preparing batches? For example, instead of randomly pick n samples for a batch, we pick n/c samples per class (c classes in total) to constitute a batch. Of course, we can adjust the strategy to pick hard cases more often.