Hi @a_d - I only run into this memory issue if I use max unpooling in the decoder. Unpooling requires the index set from the max pooling operation in the encoder.
I was able to run the same code without max unpooling.
I just checked, if I don’t use max unpooling the memory usage of Tesla V100 GPU raise up to 1.5 GB, but using max unpooling eats up the entire 16G memory.
±------------------------------±---------------------±---------------------+
|   1  Tesla V100-PCIE…  Off  | 00000000:D8:00.0 Off |                    0 |
| N/A   46C    P0    99W / 250W |   1443MiB / 16160MiB |     84%      Default |
|                               |                      |                  N/A |
±------------------------------±---------------------±---------------------+