Thanks! Applying VGG16 convolutionally worked great for me.
However,  with the current pytorch API, is it possible to build a function that takes (row, col) indices and a (height, width) block size list to get their corresponding patches efficiently ?
It might be useful to get patches that satisfy certain criteria like false negatives, etc.