Your answer seems to suggest that on-policy methods do not use experience replay. Could you clarify?
Suppose I replace deep q-learning with SARSA (which is on-policy) and use experience replay then wouldn’t it be on-policy experience replay?