Solved by ProGamerGov in post #2 
              
              
                Looks like using this code does nothing: 
handle = torch.utils.hooks.RemovableHandle(module._forward_hooks)
handle.remove()

While, simply setting the value back to it’s default removes the hooks: 
from collections import OrderedDict
from typing import Dict, Callable

module._forward_hooks: Dict[int…