Hi, I modified detectron2 2 Mask X152 7 model for apex training. Besides standard “three lines of code” change in trainer’s class, I’ve decorated roialign and deconv custom layers to force 32-bit for them.
My main goal was to reduce memory, but unfortunately it didn’t happen.  Although after reading brief description of recommended opt_level=O1 7 it’s not clear to me, if I should expect them at all. Seems like only computations are done in 16bit (after casting), but “storage” is mostly 32bit.
Should I try to adjust code to opt_level=O2?