Okay, it was actually a stupid mistake I made in producing the characters with the trained model: I got confused with the batch size and assumed that at each step the network would predict an entire batch of new characters when in fact it only predicts a single one… Yikes!
Anyways, thanks for your advice and I’ll see if I can use it to fine tune the results a bit!