Thank you! I agree that overriding the forward function would be the best way to do it. To do this, do you mean to build a new googlenet_like class inherited from from googlenet class, then, to override the forward function?
NB. Currently, googlenet in tochvision/googlenet.py is working out-of-the-box without any extra dependencies, except the need to complement it with utils.py  (from utils import load_state_dict_from_url); although this has little impact for my case as the pretrained model has dropout in its structure. Got acc1 of 20% after 9 epochs on CIFAR-100, trained from scratch.
Sounds I had the problem with the logits thing, and have resolved it already.