No, hidden_states stores the historical states of model predictions. For example
if given ‘h e l l’ , the model would likely to predict the next one is ‘o’;
if given ‘h e a v e’, it would likely to predict the next one is ‘n’.
For your case, if there isn’t any historical information, you can set hidden_state as None