Hi, Thank you for helping!
For both cases, I am using CPU only.
I installed from a binary for both cases. In my local machine, what I used is libtorch for Mac. While on linux clusters, I have tried different versions of libtorch and observed this issue always. Also I noticed that on clusters, running time at different times are quite different. Sometimes, it takes 0.4 seconds. Sometimes, it takes maybe only 0.03 seconds for a same input. In addition, after i reduce the model size from 90M to 4 M, the running speed on my local machine improved. However, on clusters, the running speed seems almost unchanged. It feels just like on clusters, there is some extra processing that takes some time. I am so confused.