How much slower are you expecting though?
The speed could be affect by other factors such as other layers or batch size, such that the difference is insignificant. Maybe it was 5% slower and you didn’t measure it correctly.