Normally you can use the prepare_for_model to add any new keys. The token_type_ids themselves are defined in the create_token_type_ids_from_sequences function, so you could probably use the BertTokenizer and subclass it while implementing those two.