Hi,
This is good news, but it is a bit surprising indeed.
It will be doing the forward twice instead of once, so it should not become that much faster.
Also you’re check-pointing the whole model so the peak memory usage shoudn’t be reduced that much.
How do you measure the memory and time?
Do you have anything else running on the GPU or other users using the machine?