text: Title: Support for Multi-Modality Models (DeepSeek Janus-Pro-7B)
  Body: ### Feature request
  
  I’m requesting support for multi_modality models in transformers, specifically for models like DeepSeek Janus-Pro-7B.
  
  Currently, when attempting to load this model using AutoModel.from_pretrained(), I received the following error:
  KeyError: 'multi_modality'
  
  During handling of the above exception, another exception occurred:
  
  ValueError                                Traceback (most recent call last)
  [/usr/local/lib/python3.11/dist-packages/transformers/models/auto/configuration_auto.py](https://localhost:8080/#) in from_pretrained(cls, pretrained_model_name_or_path, **kwargs)
     1092                 config_class = CONFIG_MAPPING[config_dict["model_type"]]
     1093             except KeyError:
  -> 1094                 raise ValueError(
     1095                     f"The checkpoint you are trying to load has model type `{config_dict['model_type']}` "
     1096                     "but Transformers does not recognize this architecture. This could be because of an "
  
  ValueError: The checkpoint you are trying to load has model type `multi_modality` but Transformers does not recognize this architecture. This could be because of an issue with the checkpoint, or because your version of Transformers is out of date.
  
  ### Motivation
  
  I’d like to use DeepSeek Janus-Pro-7B with transformers, but since it’s labeled as multi_modality, it cannot be loaded.
  
  Is there an ETA for support?
  Are there any workarounds to load the model until official support is added?
  
  ### Your contribution
  
  At this time, I am unable to submit a PR, but I am happy to help with testing once support for multi_modality models is added. If there are any workarounds or steps to try, I’d be glad to assist in debugging and verifying compatibility.