In the LSTM language modelling example, https://github.com/pytorch/examples/blob/master/word_language_model/main.py 20,
we have a learning rate of 20, which seems to be very high. What was the optimizer used, and are there any explanations for choosing a initial learning rate of 20 (with no decay, as far as I can see)? Thank you!