You just point out the right solution. I am not understood how defining in “init”, it calls during backward in every epoch? I just assumed till now “init_” doesn’t play role in forward or backward. It just instantiated once during model creation.