None in openAi-gpt tokenization
Hi
I want to concat two sentences, and give it to openAI-gpt, I use cl sentence1 sep sentence2 sep
I got none with openai-gpt in the first position, could you tell me what is the expected format? thanks
Are you using the GPT tokenizer? If not try

```
tokenizer = transformers.OpenAIGTPTTokenizer()
input_ids = tokenizer.encode(your_text)
```

<|||||>This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
