hey @MSJohannessen, it sounds like you’re looking for a retriever-reader architecture - for that i’d suggest taking a look at haystack 5 (built on top of transformers).
you can find a covid-19 example along the lines you’re talking about here: DataMuni: Building A Faster & Accurate Search Engine with Transformers & Haystack 3
in general, you can use squad2 models as baselines for the reader, but you’ll probably get better performance by fine-tuning them on your corpus