It depends on what you are profiling.
The execution of a batch with more than a sample vs. a single sample is expected to be slower, since you are using more operations. However, the epoch time would usually decrease, i.e. the samples per second performance would be faster using a batched training unless your code is bottlenecked by another operation and the actual compute speedup is not visible.