When I set fp16_opt_level == O2 or O3,  I can not use multiple GPU
## ❓ Questions & Help

<!-- A clear and concise description of the question. -->

We need more information, like a full error log and the detailed command line you used for instance.<|||||>This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
