It seems nn.functional.interpolate is working on CPU instead of GPU.
The CPU occupancy is 100%, however the GPU occupancy  is merely 11%.
Here are the parts my model forward codes, I wrote the nn.functional.interpolate into it.
Can the nn.functional.interpolate function be ran by cuda?
    def forward(self, x):
        x = nn.functional.interpolate(x, scale_factor=self.scale, mode='bicubic',align_corners=True)
        return x


image.png823×772 13.7 KB