Sorry but I don’t get your point. Do you mean to say that I should zero out the required weights  before each forward phase?
That would definitely work for now but I was thinking if there was a more efficient solution.
EDIT: You’re right that no information will flow through those weights, but the weights themselves could change due to gradient descent right?