I’d probably check the individual outputs of the encoder and decoder and try to zero in to the problem. Try to check the filter weights if they are 0. Or perhaps the input vectors are negative causing the relu to output zeros at some point ?