Thanks you for kind reply!
Minor question: Is this right that nn.Conv2d(3, 6, groups=3)? This is because I saw the following in ConvNd module,
       self.weight = Parameter(torch.Tensor(
            out_channels, in_channels // groups, *kernel_size))