nn.InstanceNorm1d will calculate the statistics for each sample in the batch separately.
While this might be an advantage over batchnorm layers for small batch sizes (unsure if InstanceNorm would perform better than e.g. GroupNorm), the statistics would still need more than a single scalar in the temporal dimension.