It  was very confused, I found that a singe image of size 3 * 1024 * 2048 with GTX 1080ti(11GB memory) can not’t handle than with fcn like CNN model based on densenet (Pytorch 0.40) However,  pytorch 0.3.1 can handle it