Solved by tom in post #4 
              
              
                As far as I understand, the AMP (now from PyTorch) and the fused kernels (still from apex) are largely independent even if the module is called amp_C, so you would only need to install apex. 
In general my impression was that fairseq is relatively well maintained and the people have good access to P…