Basically, there are two reinforcement learning policy networks (but that shouldn’t matter). The losses are separate  (I tried to feed them with different rewards, etc.). But I must have made a mistake somewhere and somewhere they coincide.