On Module level, you don’t need to since autograd doesn’t operate on this level. However, if you implement a Function, then you should supply a backward function because each Function is a link in the computation graph.