Thank your very much for the answer vivekm. I’ll try to use both my version and the Captum one to see if they are consistent and try to inspect this particular case a bit more (99% of the times using relu works fine).