Btw for batch size 8:
23.229380130767822
0.024968624114990234
0.023113250732421875
1.4580109119415283
24.699864387512207
0.018816709518432617
0.01724529266357422
0.017206192016601562

So it grows linearly