Indeed the number of kernels is the out_channels parameter of the nn.Conv2d layers. Increasing this value will result in more filters/kernels and therefore larger models with larger capacity, which might be what works for your data.