I hadn’t heard of this paper, thanks!  One convenient feature of the noisy networks paper is that you optimize the variance parameters with the other parameters of the network, throwing away the need for an adaptive scaling schedule like that.  Looking forward to seeing a rigorous comparison of all these methods.