Hi,
You code sample does not show how bias_d is used so not sure how to answer.
That being said, in what you showed, if alpha is 0, then both these gradients will be 0.
I guess a good way to debug this is to print the different values during the forward to make sure they are what you expect.