@ptrblck
awesome, a tentative one maybe ? (like in weeks, months) 
actually i am moving my codebase to pytorch-lightening and I was reading that pytorch-lightening has already included the support of native cuda amp (whenever torch1.6) is released. I would like to use the FP16 training feature soon, otherwise i will have to think of relying on torch-nightly or apex in my project.