Hi,
Which version are you using?
There was a bug where a small amount of memory was always allocated on gpu 0 when any gpu tensor was printed. This has been fixed in master.
To avoid this, you can use CUDA_VISIBLE_DEVICES=1 to hide other gpus and be sure you don’t use them.