ptrblck:

It depends highly on your use case and I can’t give a general answer.


Please correct me if I’m wrong but from the docs what I understand (unless it’s otherwise stated) is that we should avoid retain_graph=True?
Could you give a two cent summary on how 1. and 2. are dependent based on use case? What would be the major diff. in chosing one versus the other?
Thanks a lot!