Oh I see. You can use python indexing to get the layers in a nn.Sequential container. So it would be self.block1[1].momentum = .... If you want to change momentum for all BN modules in a network, you can iteration through your networks net.modules and test if it is a BN module.