Solved by InnovArul in post #2 
              
              
                Print decoder.parameters() shapes to see what parameters,  the Decoder contains. If it contains Encoder parameters as well,  you may only optimize the Decoder.