Solved by ptrblck in post #3 
              
              
                Are you setting your model to evaluation using model.eval() before feeding in your data? 
If that’s the case, could you post a (small) executable code snippet, so that we could have a look?