Solved by nielsr in post #2 
              
              
                Yes that’s possible, like so: 
from transformers import BertTokenizer, BertForQuestionAnswering

tokenizer = BertTokenizer.from_pretrained('bert-base-uncased')
model = BertForQuestionAnswering.from_pretrained('bert-base-uncased')

context = "Jim Henson was a nice puppet"
questions = ["Who was Jim He…