Hi @apaszke,

Why do you define forward_prop and not forward?

For this question, I am not sure what the relevance is as far as the name goes?.. Perhaps I am missing something - but to be honest I had defined it before in my class and it worked - perhaps I am missing something deeper here? It’s just a name of the forward propagation function that I give…

What’s the input size?

This one is a 100x100 image, single channel, minibatch size of 16.

On which GPUs are the modules? On which GPU is the input?

I believe they are all on my GPU 1, and I only say this because when I nvidia-smi, this GPU is the only one that seems to ever be used. Put another way - at no where in my code have I explicitly specified that I want to use specific GPUs, except for the device_ids in the seemingly problematic statement.