Thank you very much for your answer. I appreciate it very much.
What do you exactly mean with a “prompt” (or engineering of a prompt)? I tried to search for it but I did not get it.
Second, I only have 11 GB GPU for inference. What bigger model compared to GPT2 would you recommend that fits within 11 GB GPU?