Cannot answer about an average map. You can use torch.nn.functional. interpolate and bilinear modeto upsample images (per channel) up to original size.
It works quite well, I upsampled 8x8 to 224x224.