File size: 1,783 Bytes
bd6140a
 
 
 
 
 
 
3cd4943
 
1147a8e
62a37ec
3cd4943
62a37ec
8c68143
 
 
62a37ec
3cd4943
62a37ec
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3cd4943
e64a9c3
3cd4943
e64a9c3
 
 
 
62a37ec
3cd4943
 
e64a9c3
 
 
 
62a37ec
3cd4943
 
e64a9c3
 
 
 
 
 
62a37ec
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
---
datasets:
- Norod78/Yarn-art-style
base_model:
- stabilityai/stable-diffusion-xl-base-1.0
tags:
- art
- comic
pipeline_tag: text-to-image
library_name: diffusers
license: apache-2.0
---
iamno-one/sdxl_dreambooth_lora_yarn_art_v3 is finetuned a SDXL base with Dreambooth Lora for style transfer.
# Github repo
[Check Git Repo](https://github.com/aryama-ray/yarn-comic-SDXL-DreamboothLora)


# Model Card for Model ID
<pre>from diffusers import DiffusionPipeline, AutoencoderKL
import torch

vae = AutoencoderKL.from_pretrained("madebyollin/sdxl-vae-fp16-fix", torch_dtype=torch.float16)

pipe = DiffusionPipeline.from_pretrained(
    "stabilityai/stable-diffusion-xl-base-1.0",
     vae=vae,
    torch_dtype=torch.float16,
    variant="fp16",
    use_safetensors=True
).to(device)


## adding Lora weight
pipe.load_lora_weights("iamno-one/sdxl_dreambooth_lora_yarn_art_v3")

</pre>

## Sample Prompt

<pre> prompt = "a mother playing with a toddler girl in the park,yarn art style"
negative_prompt = "blurry, low quality, distorted, extra limbs, bad anatomy, deformed face, realistic face"
image = pipe(prompt,height=512, width=512).images[0]
image.show() </pre>
![Sample Output1](sample_3.png)


<pre> prompt = "a girl playing with a balloon, yarn art style"
image = pipe(prompt,height=512, width=512).images[0]
image.show()
</pre>
![Sample Output2](sample_2.png)


<pre>
prompt = "a toddler girl went to zoo,sunny background with lots of trees.The girl is looking at a monkey. Monkey is inside the cage. Toddler girl is standing outside the cage, in yarn art style"
negative_prompt = "blurry, low quality, distorted, extra limbs, bad anatomy, deformed face, realistic face"
image = pipe(prompt,height=512, width=512).images[0]
image.show()
</pre>
![Sample Output3](sample_6.png)