Also, scaling the noise in proportion to variance it causes in outputs like in OpenAI version might help as well:
https://arxiv.org/abs/1706.01905 93
^look at paragraph titled “Adaptive Noise Scaling” in Section 3