        "loss_scale_window": 1000,
        "initial_scale_power": 16,
        "hysteresis": 2,
        "min_loss_scale": 1
    }
}
But then you're on your own synchronizing the [Trainer] command line arguments and the DeepSpeed
configuration.
Here is the documentation.
To configure apex AMP-like mode set:
json
"amp": {
    "enabled": "auto",
    "opt_level": "auto"
}
and the [Trainer] will automatically configure it based on the values of args.fp16_backend and
args.fp16_opt_level.
This mode gets enabled when --fp16 --fp16_backend apex --fp16_opt_level 01 command line args are passed.
You can also configure this mode explicitly:
json
{
    "amp": {
        "enabled": true,
        "opt_level": "O1"
    }
}
But then you're on your own synchronizing the [Trainer] command line arguments and the DeepSpeed
