hi @khmcnally,
I was running this:
m = BigBirdModel.from_pretrained("google/bigbird-roberta-base")
sample = tokenizer("Hello, my dog is cute", return_tensors="pt")
m(**sample)

and it’s working for me. Are you using model in some other configuration? If so, please share that, I will try to run.