ptrblck:

Since it’ll be created in each forward pass, you can define your computation e.g. using conditions etc. That’s why your model architecture might even change based on some conditions.


Thank you! I think I got the idea now.