I still don’t know the answer to these questions, and they seem important for understanding of how to write pytorch code. I looked through an answer on the forum as well as the pytorch documentation (i.e. memory best practices) and didn’t find anything. If someone knows the answer or has a source of where I can find out myself, help would be very very welcome!