oh, I see. Just using the QAT model in eval will run just find on CUDA, with all int8 emulation effects. So, there is literally nothing special to do. Is that right?
In terms of eval speed on CUDA, then would it be still a good idea to drop observers? or just disabling them would be sufficient?
Thanks!