If your model is flexible regarding the input shapes, it would be possible.
E.g. for a CNN you could use an adaptive pooling layer before flattening the activation and passing it to the linear layer to accept more flexible spatial shapes.
I’m not sure, if I understood your use case correctly, so please feel free to add more information.