Thanks @ptrblck I’m also trying to train the entire resnet101/DeepLabv3 model with the aux classifier using something like
loss = loss1 + 0.4 * loss2 # 0.4 is weight for auxillary classifier

But it’s training very very slow. Should I change the 0.4 weight to a much lower value? I’m trying with a LR of 0.001 and 0.01. My input images are normalised and size 256 square.