Hi Ashwin,
there’s a good implementation of prioritized experience replay, (in TensorFlow unfortunately), by OpenAI - https://github.com/openai/baselines/blob/master/baselines/deepq/replay_buffer.py 147
Would be fun to try to port it over to PyTorch  Seems that PER buffer is language agnostic?
Best,
Ajay