Hi @swayson, not an expert here but fine-tuning on your domain should give better results. I can’t comment on if 1000 examples will e enough or not, you’ll probably need to experiment.
Also have look at this question generation models 15. You can try to create synthetic QA corpora using these models. Synthetic QA corpora has shown to improve results for QA.