Josiane_Rodrigues:

therefore the same weight matrix of the output layer is used to update the input layer


Could you explain it a bit?
Would you like to use the same gradients from the output layer on your input layer or copy the weights into the input layer after each update?