alpha is not used in the computation graph, but instead is used to create the weight parameter.
If you want to update alpha and keep weight constant, create weight as a tensor and use alpha during the forward pass.