Hello @PaschiSt, sorry for my late reply.
Unfortunately, I don’t have a repo for that, and I didn’t manage to collect the data I planed for continue the pre-training.
But I remember that, as I mentioned in the previous comment, the script run successfully. So, if you follow the detailed description of the scripts’ page, and you give the input data to the script accordingly (if I remember a text per line), you won’t have a problem with the pre-training.
Hope that this helped somehow.