Thank you for the reply. Im not sure I get your idea fully.
If we are talking about only one filter of size (3 x 3). It is randomly initialized by pytorch. How do I specify that this filter rows only be applied at certain index rows of the input.
Im sorry but I cant make sense of your answer. Could you please elaborate a bit. Thank you!