Hi @zetyquickly , thank you! Sorry it is a private project, so I cannot share the exact testing code on colab.
Hi @InnovArul , thank you! I checked the temperature. Idle GPU temperature is 34°C, during inference it is 53°C, so it is not about the temperature.