Which adaptive module are you using and what’s the input size? Also, could you profile your network and post the results please (http://pytorch.org/docs/master/autograd.html?highlight=profiler#profiler 10)? Thanks!