the neurons will be able to keep a history of who precedes them at the time of updating the weights

Not sure what that means.
But if the question is “Will it be able to compute gradients?”, then the answer is yes.