The allocated memory should decrease while using amp, while the max. allocated memory might yield a higher peak, e.g. if the transformed parameters are stored additionally in the cache.
If depends on the model and you should not run OOM using amp while the vanilla training is working.