I have to admit it’s a strange question to ask for a specific bug. 
However, if you set your batch norm to .eval() in PyTorch, the result will not be depending on the batch and the running estimates will be used for each sample.
Let us know, if you encounter any strange behavior.