Solved by justusschock in post #4 
              
              
                Simply spoken: 
The difference here is, that the kernels have been trained to a specific image size (224) and thus the features they usually extract are usually of a certain size. 
If you use smaller images, the kernels might not be able to extract the features with the usual size, since they are sm…