I’m now a bit confused.  So, if I understand you correctly the task is to train GPT2 for sentence completion. Let’s assume that I have used a transformer to summarize the wikipedia article about a person. How shall I use this for learning sentence completion? Because the summarization still contains several sentences.
And how can this help the chatbot? Because for the chatbot I don’t want sentence completion but a complete sentence as an answer to another sentence.