tanh and sigmoid does not quite affect the performance.
Anything that will output a positive value can be used as your sigma (scale) activation, softplus is commonly used because its smooth, close to linear (y=x) when x >> 0 and works on the negative region.