Hey @ptrblck! Thanks for replying! 
I see, I will train using a smaller learning rate.
But am I using the residual block in a correct way?
I am asking that because before I add the residual block, the loss value during the training was decreasing and the learning rate was the same value, 0.1.