Right now I’ve been experimenting with a couple of different GAN and VAE models; the GANs are roughly twice the GPU utilization which I assume is due to the dual generator and discriminator networks, but even then the models rarely peak beyond 45% or so.
I haven’t spent a lot of time on the performance profiling aspect of this, I just assumed that something as computationally expensive as a GAN would utilize more GPU resources than what I am seeing.