I would assume the model should work the best during validation using images with shapes and other properties as close as possible to the training data.
The shape limits are most likely added due to the architecture (but I haven’t looked into the source code to verify it).