You could profile your script and check which part of the overall pipeline is the current bottleneck.
E.g. if the data loading and processing is too slow, a model speedup won’t be visible as your training routing would have to wait for the next batch to be available.