Solved by ptrblck in post #2 
              
              
                I don’t think “downscaling” is referring to the spatial size, but to a multiplicative factor. 
Here normalization is mentioned: 

which seems to point towards using a constant factor for the downscaling via: 
act = act * 1/factor