Solved by tom in post #2 
              
              
                Hi Sebastian, 
I think it’s a tradeoff between time and GPU memory. 
For the memory: With the setup in the code, you can produce and process the autograd graphs for real and fake separately, so in a very lame sense, you can “double the batch size”. 
In terms of performance: In the end, yes, without …