Yes it will track all the previous ones.
Can you explain which part you want to backpropagate through?

Do you want to go all the way to the first iteration?
Do you want to backprop only the last func eval?
Do you want to backprop only the last two?