Nimrod_Daniel:

It could have been great if I could perform a QAT using CUDA instead of dealing with the conversion, hopefully a CUDA support will available soon.


calling prepare and running the QAT fine-tuning is supported on CUDA.  The only thing not supported is calling convert and running the quantized kernels.  Not sure if that is what you were referring to.