Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,123 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: apache-2.0
|
3 |
+
language:
|
4 |
+
- en
|
5 |
+
base_model:
|
6 |
+
- Wan-AI/Wan2.1-I2V-14B-480P
|
7 |
+
- Wan-AI/Wan2.1-I2V-14B-480P-Diffusers
|
8 |
+
pipeline_tag: image-to-video
|
9 |
+
tags:
|
10 |
+
- text-to-image
|
11 |
+
- lora
|
12 |
+
- diffusers
|
13 |
+
- template:diffusion-lora
|
14 |
+
- image-to-video
|
15 |
+
widget:
|
16 |
+
- text: >-
|
17 |
+
A man with short hair and a beard clenches his fists, staring forward. His hair brightens to glowing yellow, spiking up as gold energy surges around his body. The background pulses with yellow light, and sparks crackle in the air during his 5up3r super saiyan transformation, real life style.
|
18 |
+
output:
|
19 |
+
url: example_videos/super1.mp4
|
20 |
+
- text: >-
|
21 |
+
A South Asian man with dark hair and a beard clenches his fists, staring forward. His hair brightens to glowing yellow, spiking up as gold energy surges around his body. The background pulses with yellow light, and sparks crackle in the air during his 5up3r super saiyan transformation, real life style.
|
22 |
+
output:
|
23 |
+
url: example_videos/super2.mp4
|
24 |
+
- text: >-
|
25 |
+
An old Asian man with short hair clenches his fists, staring forward. His hair brightens to glowing yellow, spiking up as gold energy surges around his body. The background pulses with yellow light, and sparks crackle in the air during his 5up3r super saiyan transformation, real life style.
|
26 |
+
output:
|
27 |
+
url: example_videos/super3.mp4
|
28 |
+
- text: >-
|
29 |
+
A man with curly dark hair and a beard clenches his fists, staring forward. His hair brightens to glowing yellow, spiking up as gold energy surges around his body. The background pulses with yellow light, and sparks crackle in the air during his 5up3r super saiyan transformation, real life style.
|
30 |
+
output:
|
31 |
+
url: example_videos/super4.mp4
|
32 |
+
---
|
33 |
+
|
34 |
+
<div style="background-color: #f8f9fa; padding: 20px; border-radius: 10px; margin-bottom: 20px;">
|
35 |
+
<h1 style="color: #24292e; margin-top: 0;">Dragon Ball Super Saiyan LoRA for Wan2.1 14B I2V 480p</h1>
|
36 |
+
|
37 |
+
<div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
|
38 |
+
<h2 style="color: #24292e; margin-top: 0;">Overview</h2>
|
39 |
+
<p>This LoRA is trained on the Wan2.1 14B I2V 480p model and allows you to turn anyone into a Super Saiyan. The effect works on a wide variety of objects, from animals to people!</p>
|
40 |
+
</div>
|
41 |
+
|
42 |
+
<div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
|
43 |
+
<h2 style="color: #24292e; margin-top: 0;">Features</h2>
|
44 |
+
<ul style="margin-bottom: 0;">
|
45 |
+
<li>Transform any image into a video of the subject turning into a Super Saiyan</li>
|
46 |
+
<li>Trained on the Wan2.1 14B 480p I2V base model</li>
|
47 |
+
<li>Consistent results across different object types</li>
|
48 |
+
<li>Simple prompt structure that's easy to adapt</li>
|
49 |
+
</ul>
|
50 |
+
</div>
|
51 |
+
|
52 |
+
<div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
|
53 |
+
<h2 style="color: #24292e; margin-top: 0;">Community</h2>
|
54 |
+
<ul style="margin-bottom: 0;">
|
55 |
+
<li><b>Discord:</b> <a href="https://discord.com/invite/7tsKMCbNFC" style="color: #0366d6; text-decoration: none;">Join our community</a> to generate videos with this LoRA for free</li>
|
56 |
+
<li><b>Request LoRAs:</b> We're training and open-sourcing Wan2.1 LoRAs for free - join our Discord to make requests!</li>
|
57 |
+
</ul>
|
58 |
+
</div>
|
59 |
+
</div>
|
60 |
+
|
61 |
+
<Gallery />
|
62 |
+
|
63 |
+
# Model File and Inference Workflow
|
64 |
+
|
65 |
+
## 📥 Download Links:
|
66 |
+
|
67 |
+
- [super_saiyan_35_epochs.safetensors](./super_saiyan_35_epochs.safetensors) - LoRA Model File
|
68 |
+
- [wan_img2vid_lora_workflow.json](./workflow/wan_img2vid_lora_workflow.json) - Wan I2V with LoRA Workflow for ComfyUI
|
69 |
+
|
70 |
+
---
|
71 |
+
<div style="background-color: #f8f9fa; padding: 20px; border-radius: 10px; margin-bottom: 20px;">
|
72 |
+
<div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
|
73 |
+
<h2 style="color: #24292e; margin-top: 0;">Recommended Settings</h2>
|
74 |
+
<ul style="margin-bottom: 0;">
|
75 |
+
<li><b>LoRA Strength:</b> 1.0</li>
|
76 |
+
<li><b>Embedded Guidance Scale:</b> 6.0</li>
|
77 |
+
<li><b>Flow Shift:</b> 5.0</li>
|
78 |
+
</ul>
|
79 |
+
</div>
|
80 |
+
|
81 |
+
<div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
|
82 |
+
<h2 style="color: #24292e; margin-top: 0;">Trigger Words</h2>
|
83 |
+
<p>The key trigger phrase is: <code style="background-color: #f0f0f0; padding: 3px 6px; border-radius: 4px;">5up3r super saiyan transformation</code></p>
|
84 |
+
</div>
|
85 |
+
|
86 |
+
<div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
|
87 |
+
<h2 style="color: #24292e; margin-top: 0;">Prompt Template</h2>
|
88 |
+
<p>For prompting, check out the example prompts; this way of prompting seems to work very well.</p>
|
89 |
+
|
90 |
+
|
91 |
+
<div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
|
92 |
+
<h2 style="color: #24292e; margin-top: 0;">ComfyUI Workflow</h2>
|
93 |
+
<p>This LoRA works with a modified version of <a href="https://github.com/kijai/ComfyUI-WanVideoWrapper/blob/main/example_workflows/wanvideo_480p_I2V_example_02.json" style="color: #0366d6; text-decoration: none;">Kijai's Wan Video Wrapper workflow</a>. The main modification is adding a Wan LoRA node connected to the base model.</p>
|
94 |
+
<img src="./workflow/workflow_screenshot.png" style="width: 100%; border-radius: 8px; margin: 15px 0; box-shadow: 0 4px 8px rgba(0,0,0,0.1);">
|
95 |
+
<p>See the Downloads section above for the modified workflow.</p>
|
96 |
+
</div>
|
97 |
+
</div>
|
98 |
+
|
99 |
+
<div style="background-color: #f8f9fa; padding: 20px; border-radius: 10px; margin-bottom: 20px;">
|
100 |
+
<div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
|
101 |
+
<h2 style="color: #24292e; margin-top: 0;">Model Information</h2>
|
102 |
+
<p>The model weights are available in Safetensors format. See the Downloads section above.</p>
|
103 |
+
</div>
|
104 |
+
|
105 |
+
<div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
|
106 |
+
<h2 style="color: #24292e; margin-top: 0;">Training Details</h2>
|
107 |
+
<ul style="margin-bottom: 0;">
|
108 |
+
<li><b>Base Model:</b> Wan2.1 14B I2V 480p</li>
|
109 |
+
<li><b>Training Data:</b> Trained on 1 minute of video comprised of 13 short clips (each clip captioned separately) of various Super Saiyan transformations</li>
|
110 |
+
<li><b> Epochs:</b> 35</li>
|
111 |
+
</ul>
|
112 |
+
</div>
|
113 |
+
|
114 |
+
<div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
|
115 |
+
<h2 style="color: #24292e; margin-top: 0;">Additional Information</h2>
|
116 |
+
<p>Training was done using <a href="https://github.com/tdrussell/diffusion-pipe" style="color: #0366d6; text-decoration: none;">Diffusion Pipe for Training</a></p>
|
117 |
+
</div>
|
118 |
+
|
119 |
+
<div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
|
120 |
+
<h2 style="color: #24292e; margin-top: 0;">Acknowledgments</h2>
|
121 |
+
<p style="margin-bottom: 0;">Special thanks to Kijai for the ComfyUI Wan Video Wrapper and tdrussell for the training scripts!</p>
|
122 |
+
</div>
|
123 |
+
</div>
|