Hello, thanks for your reply. Finally, I found the solution to the problem. It was a setting related to mlagents where I have set the branch size to 0 instead of 1. I write it in case someone encounter the same issue🙂