I am sorry, I should have been more clear about the activation function
x *( torch.tanh(F.softplus(x, beta = random.uniform(self.beta_lower, self.beta_higher))))

This is the function I want to use. And I want to know the best way to get a different beta for each neuron.
Thanks for your patient response!