So I’m noticing that when using a 152 resnet training on batches of 20 that the total speed up per batch is about 30%. Does this signal that I’ve set something up wrong elsewhere in my code? Is there a way to avoid the synchronization step?