Hi eveningkid,
transformer models are designed for text.
It might be possible to force the model to accept a numeric representation of an image (after all, it’s all ones and noughts), but it would be unlikely to do anything useful.