Hi,
use_cuda wil only impact the profiler: it will only allow the profiler to properly time cuda calls or not.
Is your model wrapped in a DataParallel or similar construct?  Could you give more details about your model?