I suppose it would be related to the downsampled output from the final intermediate max pool layer (showing the compressed representation), giving me a 3x3…but I can’t really upscale that nicely into a 28x28 because 3 is not a multiple of 28. Is there a general principle here that I am ignoring?