I tried on spyder with break points and did verify that it doesnt go in backward function and only forward function,  I added the video on the drive to show the same. link → https://drive.google.com/file/d/1syyINqYyxNDhXB8R2AvjxVou3pNotoiT/view?usp=sharing
in the link you can see that using breakpoints that it doesn’t go inside the backward function
I have also attached a link of video where device-cpu it goes inside both forward and backward . https://drive.google.com/file/d/14wLux7N5iWl4DqHYY8R7YEGXa0kNvG2-/view?usp=sharing
It looks like it is using pytorch gradient calculations for backward pass rather than the custom backward introduced in the leaky relu function. Is there an option to check if it is using python gradient calculation or the one that i have in . Thanks again