Hi,
This looks very similar to https://github.com/pytorch/pytorch/issues/32284 94.
Does it actually run out of memory (like your process gets killed by the OS)? Or does it stabilizes when it gets to full memory?