Are you loading a state_dict object or a custom checkpoint implementation of fastai?
I’m not deeply familiar with the source code of fastai, so @jphoward might give some insight on how to get the underlying model.