why is the receptive field size not depend on the input image? Let say if I fixed the filter size as 3x3, then shouldn't an input of 128x128 image has a larger receptive field size than an image of 32x32?
In addition, what would be the affect of stride and padding on the receptive fields?
thank you.

To answer the second part of the question:

In addition, what would be the affect of stride and padding on the receptive fields?

As explained in Nikolas Adaloglou's blog on AI Summer Understanding the receptive field of deep convolutional networks, increasing the stride in a convolutional layer will increase the receptive field in subsequent convolutional layers. Padding doesn't change the receptive field.
For example, consider a network with two $3\times3$ convolutional layers. The first layer has a receptive field (RF) of $3\times3$ irrespective of the stride. The RF of the second layer changes with different strides used in the first layer. If the stride of the first layer is 1, then the RF of the second layer is $5\times5$. If the stride of the first layer is 2, then the RF of the second layer increases to $7\times7$ and if the stride of the first layer is 3, then the RF of the second layer is $9\times9$.
