For some models the input might be too small since some intermediate activations might be smaller than a specific conv kernel.
If you encounter these issues, you would have to increase the input up to a specific size until at least a single pixel is produced by the feature extractor.
Depending on the model architecture the minimal size might be smaller than 224x224.