Sorry, GAP = Global Average Pooling 64. More than timing, I was worried of correctedness of assigning to network.avgpool the new operation. Is this the correct way of doing  so? I would assume that, since I would probably get an error if it wasn’t. I am just scraping the bottom of the barrel in order to understand why I get such weird results. For example, the loss goes down (to an accuracy of around 100%) before spiking up to a extremely high value for few iterations:
image848×446 24.9 KB