Apparently the backward() in a custom autograd.Function does not get called by a python method directly (see also this blog entry regarding coverage tests 4), which is why breakpoints set within these backward() methods never get triggered. Is there another way to use a python debugger for these backward passes?