Changing the hyperparameters such as the kernel size and number of kernels can increase or decrease the performance and depends on the model architecture as well as your use case, so I don’t think you can generalize it via your statements.
You could try to derive some insights about the number of filters, thus number of parameters, and the related “capacity” of the model.