IP-Adapter relies on an image encoder to generate image features. If the IP-Adapter repository contains an `image_encoder` subfolder, the image encoder is automatically loaded and registered to the pipeline. Otherwise, you'll need to explicitly load the image encoder with a [`~transformers.CLIPVisionModelWithProjection`] model and pass it to the pipeline.  
This is the case for *IP-Adapter Plus* checkpoints which use the ViT-H image encoder.  
```py
from transformers import CLIPVisionModelWithProjection