I wonder if transferring the model and data to the gpu by calling .cuda() produces any significant overhead.
For reference, I’m using a resnet-18, so I also wonder if a small model has a significant advantage of using CPU over GPU. Thanks.