Solved by 1chimaruGin in post #2 
              
              
                The following sentences are from this post by  Saurabh Bagalkar. This might help you. 
Need for Spatial Pyramid Pooling
But why do we have to do the spatial pyramid pooling in the first place? You see, CNNs, which have dense connection representations at deeper levels, traditionally require a fixed …