Hi! There is no (known) leak, but more like problem with misunderstanding how memory works in python+forking world, we are aware of this issue and planning to fix it this year (or sooner).
Some work around discussed here: https://github.com/pytorch/pytorch/issues/13246#issuecomment-612396143 24