Little confused on somethings I see in train.py 8
What’s the whole updating old model right before you call backward and step about?
Also are you asking for help on converting model to solve other environments or that model is not able to solve other environments?