Hello, I read similar topic in initializing hidden layer in RNN network.
However they are quite confusing for me.
Right now I have the code as follows to initialize hidden layer with zeros. Could explain to me how to modify it so that it is initialized based on training? Thx Matt
def initHidden(self):
return torch.zeros((self.MiniBatchSize,self.HiddenNodes),dtype=torch.double)