I guess the RobertaConfig 2 defines the number of input features as well as other hyperparameters.
In any case, you might also want to post this question in the HuggingFace discussion board 4, since the code owners would see it there, too.