If you would like to use the feature dimension in batch norm, you could simply permute your input:
bn = nn.BatchNorm1d(1024)
x = torch.randn(64, 256, 1024)
x = x.permute(0, 2, 1)
output = bn(x)

The BatchNorm1d layer will now have 1024 running estimates.