Solved by ptrblck in post #8 
              
              
                Thanks for the update. 
Have you set the self.testing argument to True, as the last activation wouldn’t be used otherwise as seen here?