I use L1 loss function. Initially I calculated loss as mean of L1 loss but which it is dominated  by 1’s as 70-80% values are equal to 1. Later, I tried to mask out values equal to 1 and less than 1 and take their seperate mean. Later I set weight equal to 10 for values less than 1. But some how the network is not converging.