the forward propagation step is not adding the bias once i use the modified weights

Did you set it to zero somewhere else? Or you passed bias=False?

Correct me if i am wrong but am i not modifying the gradient value after it has been calculated so would it matter?

You get the gradient for what your function computes. That’s all I’m saying. If that;s what you want, then everything is fine