Looks like it isn’t available yet. See this DeBERTa in TF (TFAutoModel): unrecognized configuration class · Issue #9361 · huggingface/transformers · GitHub 23 which says that (in Dec 2020) DeBERTa was only available in pytorch, not tensorflow.