Solved by charan_Vjy in post #5 
              
              
                I don’t think i was clear. When I say change the input size to (8,2048), I meant the input to the Linear layer. This would mean the output of the Avg Pool layer before the input layer is (8,2048). You would have to make a lot of architectural changes to achieve this (need to downsample using max poo…