Hi,
Unfortunately, there is no absolute true value. It will depend on your setup.
For low number of workers, you should see an improvement whenever you add more of them. At some point, it will stop improving and just keep the same performances even with more workers. You should use the lowest number that gives you good performances.