Oh Thank you very much! I have noticed that the total threads for each block should be under 1024, and I found my methods to access global memory too many times which is terribly inefficient!
I have optimized my code to pleasant speed~
Appreciate you again!