From what you wrote it seemed to me that you pass your variable through a net (incl aux) and want to update this nets parameters. If you do no pass the variable for the main-forward through out you are right, then the out parameters won’t be updated by the main optimizer