The IP-Adapter weights need to be loaded first, then you can use [`~StableDiffusionPipeline.load_lora_weights`] to load the LoRA style and weight you want to apply to your image.  
```py
from diffusers import DiffusionPipeline, LCMScheduler
import torch
from diffusers.utils import load_image