Thanks a lot! Your explanation is helpful.
I still wonder how can I use some code to experiment on the differences made with and without retain_vairables.
Could you give me some simple code examples on showing the differences?
or could you show me how to access the source code of self._execution_engine.run_backward?
Thanks a lot!