AFAIK, conv layers don’t depend on N.
However, the batch norm would need a constraint that N != 1 during training.
Other than this, the training behavior might be different with different Ns, as the gradient will be more or less noisy depending on N.