This is the architecture of the model class it was pretrained with. If you save your model (preferably after training) using the save_pretrained method, this architectures field will be updated to put the architecture you were using.