The batchnorm layers cannot calculate the running estimates from a single sample, and raise this issue.
Your input activation would have the shape [1, 128] without a temporal dimension, where 128 are the input channels.
You could either disable the batchnorm layers via model.eval() or increase the batch size.
Also, using batchnorm layers in general for a small batch size might yield skewed running estimates.