Hi All,
I have a few questions regarding RNNs and Paddings.
I have variable length inputs I want to feed into the RNN.
If I pre-pad the sequences with numpy, and use a dataloader to create mini-batches, is it the same as using the torch.nn.utils.rnn.pack_padded_sequence?
If we pad 0s, will PyTorch use the 0 paddings as input to compute the gradient?