Amrit_Das:

the complexity to compute a single image increases because the kernel being small has to move through more number of pixels.





 RiccardoDF:

The filters do not affect the size of the layers as I’m using padding


Does the complexity means the computational cost? If so, I think the computational cost for lager kernels (i.e. 5x5 7x7) is more than the smaller in this case (padding to the same).
@RiccardoDF could you post some snippets, let us reproduce the case you encountered.