We recommend to use the native implementations for mixed-precision training as well as the DistributedDataParallelutilities, as the apex implementations were used as a proff of concept and the native implementations will be improved in the future.