In this tutorial https://github.com/prigoyal/pytorch_memonger/blob/master/tutorial/Checkpointing_for_PyTorch_models.ipynb 28
Batch size increased from 8 to 32
Here
https://qywu.github.io/2019/05/22/explore-gradient-checkpointing.html 13
from 24 to 132
On mine model I got only x2 increase from 32 to 64.
Is this ok or i doing wrong something?
How can i check if checkpoint work as intended?
Model is transformer with rnn layers.