Hi,
Could you show how you use synchronize? Your forward is suspiciously fast compared to the backward 
Also the forward/backward being slower for larger batch sizes is expected as there is more work to do!