Assuming that TF uses the shape [batch_size=None, sequence_length=96, channels=768], the specified conv layer should yield the same temporal size with 128 output channels, which would correspond to [None, 96, 128].


The input channels seem to be 768, while the output channels seem to be specified as 128. Also, for a kernel size of 2 would would need to add padding to get the same sequence length.