Thank you for your timely reply!
I wonder if there is a drop on accuracy if I use float16 rather than float32, will the performance drops a lot?
If I’m going to implement it, according to Bitwise-operations-on-cuda 14. Two ways are listed by cuda extension or cupy.