so if i initiate the weight of a conv2d or conv3d i will use gain=1
if i am right then

where’s the use of  relu or thanh gain value as these functions have no weight to initialize ?
or i will multiply gain value of conv2d and relu (1*sqrt(2)) for this case bellow
F.relu(self.conv2d())    (just i think this)
am i right?