Solved by ayalaa2 in post #3 
              
              
                Interesting problem! 
While I do see some murmurs here and there about the ability to share weights between modules, it seems pretty frown upon. 
I believe the better idea would be to use trainable parameters and make a functional call to conv2d using those trainable parameters. 
Something like this…