Solved by ptrblck in post #4 
              
              
                Your input might currently be too small for a resnet and you might get an error from a conv layer, explaining that the kernel size cannot be bigger than the input shape. 
You could try to reshape it, such that the input channels are set to 1 and the spatial sizes are increased by a factor of 16 via: …