In the explanation of pytorch, it looks like this
   \begin{array}{ll}
    r = \sigma(W_{ir} x + b_{ir} + W_{hr} h + b_{hr}) \\
    z = \sigma(W_{iz} x + b_{iz} + W_{hz} h + b_{hz}) \\
    n = \tanh(W_{in} x + b_{in} + r * (W_{hn} h + b_{hn})) \\
    h' = (1 - z) * n + z * h
    \end{array}

I don’t want to use tanh
Is there a way to change to Relu or swish?