Does the code you posted run for you? It doesn’t work for me. It never gets to up5. The up1 concatenates the input so the number of channels are 256, whilst the number of input channels in the first upsample is 128. Perhaps thats something?
Btw, what pytorch version are you running?