Hi all, I am trying to reimplement Arthur Juliani’s Simple Reinforcement Learning with Tensorflow Part 0: Q-Learning with Tables and Neural Networks 21 tutorial with PyTorch. My code is here 18.
I apologize in advance for not being able to provide more details, but basically, I am stuck, and I don’t know what I am doing wrong. I have checked code line-by-line and it appears that I have all the pytorch equivalents of Arthur’s TensorFlow code, yet my model doesn’t learn.
My suspicion is that I might have misunderstood autograd and dynamic graph building, but not sure how and when. I hope you would be able to point out my mistakes.