@Omegastick Thanks, the OpenAI 5 architecture diagram is just the sort of thing that I need for my experiments, albeit with a fewer number of observations. Is there a reference pytorch implementation that you know of for OpenAI 5, so that I can learn from that?