Text Generation, adding random words, weird linebreaks & symbols at random.
Here's the code I'm using to generate text.

`sentence= tokenizer.encode(kw, return_tensors='pt')
output = model.generate(sentence, 
max_length = 500, 
no_repeat_ngram_size  = 2,
do_sample=False)
text.append(tokenizer.decode(output[0], skip_special_tokens = True))`

The issue is that the output often comes like this:

`What are the benefits of using collagen?

,,,

 ,
 ,

 ,,
, __________________, __________
The skin that has collagen has a higher level of hydrophilic (water-loving) proteins. `

or like this:

`Yes, collagen is a natural skin-repairing substance. It is also a powerful anti-inflammatory and antiaging agent.
, and, are the most common types of collagen found in skin.`

As you can see, at the start it wrote ", and," at random and it happens EXTREMELY often, nearly in every single text generation I did.

I don't know if it's related to my settings or not but I'd appreciate all the help you guys can give. I want to get my text to be as human-readable as possible & up to 100-500 words each input.
Hi! Could you provide more information, especially regarding which model and tokenizer you're using? Also, you might have more luck asking on the [forum](https://discusss.huggingface.co), as GitHub issues are for bugs/feature requests.

Thanks!<|||||>> Hi! Could you provide more information, especially regarding which model and tokenizer you're using? Also, you might have more luck asking on the [forum](https://discusss.huggingface.co), as GitHub issues are for bugs/feature requests.
> 
> Thanks!

oh sorry forgot to include them.

		tokenizer = GPT2Tokenizer.from_pretrained('gpt2-medium') 
		model = GPT2LMHeadModel.from_pretrained('gpt2-medium' , pad_token_id = tokenizer.eos_token_id)<|||||>> Hi! Could you provide more information, especially regarding which model and tokenizer you're using? Also, you might have more luck asking on the [forum](https://discusss.huggingface.co), as GitHub issues are for bugs/feature requests.
> 
> Thanks!

if possible can you remove my account on hold on the forum? wont allow me to ask it there.

"steelhard" is the account name.<|||||>This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the [contributing guidelines](https://github.com/huggingface/transformers/blob/master/CONTRIBUTING.md) are likely to be ignored.