Have you doubled your batch size?
In this example 86 you can see, that the batch will be split among the GPUs.
If you kept the batch size as 1024, both GPUs only got 512 and thus your training couldn’t run any faster than using one GPU.