What if I just instantiate a tokenizer (e.g., BigBirdTokenizer), then used add_tokens() to add my entire vocabulary? That is, start with nothing, then “force” them in with the add_tokens() function… ??
UPDATE: Hmm… no… I can’t instantiate without a vocab file, so that won’t work…