What is the effect of



 googlebot:

self.register_buffer


in your code?
I am loading some checkpoints and with this method, the loader asks for the values of alphas. It there any work around for this problem?
How I could make a function in the way that it returns the gradients with respect to alphas, separately and not coupled with the other weights?
Is there a way that I can have separate alpha for each neuron? It seems that in this code, you used same self.alphas for all the elements of n dimensional array x.