Thanks for your help, it was great advice to check behavior on different seeds!
Probably I’ll commit my code to repo and post question about convergence with a link to it on this forum later, may be someone who is interested in RL would look into it.