Hello everyone,
Let’s say I have the following rnn.
self.rnn = torch.nn.GRU(
input_size=1024,
hidden_size=512,
num_layers=2,
batch_first=True
)
What does it mean ?
I have a basic understanding of LSTMs. the input x_t goes through a GRU, then the hidden state h_t is updated to h_{t+1} and fed into the next unit with input x_{t+1]. In that regard, I understand the hidden size (the size of my input sequence) but I don’t understand the hidden_size and the number of layers. I’m sure just seeing a relevant picture would help me, can you help me out ?