No, because they always add an epsilon that is small enough to prevent the std = 0 but still not affects a lot to the result (1e-5 or something).
I guess your problem should be related to the running mean and running variance since you set your batch size as 1, the running stats will be strong affected by the later sample. You can try to reduce the momentum or change to group norm.