Buffers are tensors, which are registered to the parent module but don’t require gradients. E.g. the running stats in batchnorm layers are buffers. You can register buffers via self.register_buffer inside an nn.Module.