Solved by ptrblck in post #2 
              
              
                You could permute the activation, treat the channels as a spatial dimension, apply F.interpolate on it, and permute the activation back to its original layout.