Hi @tadf,
I trained for 50 epochs and a learning rate of 1e-5. The learning rate scheduler was set to default (same as the article). The model does start out by predicting random chars and goes to empty strings, but even after 50 epochs, no relevant chars are created. You can see my output in the file “50epochs_output.pdf” in this folder 3.
Does this mean even more train time is needed?
Thanks!