Juna:

optimizer = tc.optim.RMSprop(main_model.parameters(), lr=0.00025, alpha=0.99, eps=1e-6)





 Juna:

out = update_model.forward(a)


You are not optimizing the correct parameters (main_model instead of update_model)