arvindmohan:

but I do want to explicitly define the hidden states


I need to do exactly the same. Any update from other threads?
My code is getting kind of messy dealing with batch_first in the RNN instance, dim=1 in the nn.DataParallel and all the functions to have the batch dimension of every object in the same position …