Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,122 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: apache-2.0
|
3 |
+
language:
|
4 |
+
- en
|
5 |
+
base_model:
|
6 |
+
- Wan-AI/Wan2.1-I2V-14B-480P
|
7 |
+
- Wan-AI/Wan2.1-I2V-14B-480P-Diffusers
|
8 |
+
pipeline_tag: image-to-video
|
9 |
+
tags:
|
10 |
+
- text-to-image
|
11 |
+
- lora
|
12 |
+
- diffusers
|
13 |
+
- template:diffusion-lora
|
14 |
+
- image-to-video
|
15 |
+
widget:
|
16 |
+
- text: >-
|
17 |
+
E13c7r1c electricity effect streaks through a swirling storm cloud, revealing the shadowy outline of a massive, winged beast. Each lightning strike illuminates its glowing blue eyes, and for a brief moment, its metal-plated wings shimmer before vanishing back into the storm.
|
18 |
+
output:
|
19 |
+
url: example_videos/1.mp4
|
20 |
+
- text: >-
|
21 |
+
The video begins with a close-up shot of a young man's face. His eyes are glowing blue, and there is a bright blue e13c7r1c electricity effect emanating from his body. The e13c7r1c electricity effect grows more intense, covering his body, and the man starts to levitate. The background is dark and blurry.
|
22 |
+
output:
|
23 |
+
url: example_videos/2.mp4
|
24 |
+
- text: >-
|
25 |
+
The video begins with a close-up shot of a man's face. His eyes are glowing blue and there is a blue e13c7r1c electricity effect emanating from his shoulders. He is in front of a dark, foggy background. The man has a determined look on his face.
|
26 |
+
output:
|
27 |
+
url: example_videos/3.mp4
|
28 |
+
- text: >-
|
29 |
+
The video begins with a wide shot of Thor holding his hammer. He is surrounded by a bright blue e13c7r1c electricity effect that looks like lightning bolts emanating from the hammer. The electricity effect is so intense it seems to be crackling and pulsating. Thor looks determined. The background is a forest.
|
30 |
+
output:
|
31 |
+
url: example_videos/4.mp4
|
32 |
+
---
|
33 |
+
|
34 |
+
<div style="background-color: #f8f9fa; padding: 20px; border-radius: 10px; margin-bottom: 20px;">
|
35 |
+
<h1 style="color: #24292e; margin-top: 0;">Electrify LoRA for Wan2.1 14B I2V 480p</h1>
|
36 |
+
|
37 |
+
<div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
|
38 |
+
<h2 style="color: #24292e; margin-top: 0;">Overview</h2>
|
39 |
+
<p>This LoRA is trained on the Wan2.1 14B I2V 480p model and allows you to electrify anything! This model also works on T2V, with a very similar prompting style.</p>
|
40 |
+
</div>
|
41 |
+
|
42 |
+
<div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
|
43 |
+
<h2 style="color: #24292e; margin-top: 0;">Features</h2>
|
44 |
+
<ul style="margin-bottom: 0;">
|
45 |
+
<li>Trained on the Wan2.1 14B 480p I2V base model</li>
|
46 |
+
<li>Consistent results across different object types</li>
|
47 |
+
<li>Simple prompt structure that's easy to adapt</li>
|
48 |
+
</ul>
|
49 |
+
</div>
|
50 |
+
|
51 |
+
<div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
|
52 |
+
<h2 style="color: #24292e; margin-top: 0;">Community</h2>
|
53 |
+
<ul style="margin-bottom: 0;">
|
54 |
+
<li><b>Discord:</b> <a href="https://remade.ai/join-discord?utm_source=Huggingface&utm_medium=Social&utm_campaign=model_release&utm_content=electrify" style="color: #0366d6; text-decoration: none;">Join our community</a> to generate videos with this LoRA for free</li>
|
55 |
+
<li><b>Request LoRAs:</b> We're training and open-sourcing Wan2.1 LoRAs for free - join our Discord to make requests!</li>
|
56 |
+
</ul>
|
57 |
+
</div>
|
58 |
+
</div>
|
59 |
+
|
60 |
+
<Gallery />
|
61 |
+
|
62 |
+
# Model File and Inference Workflow
|
63 |
+
|
64 |
+
## 📥 Download Links:
|
65 |
+
|
66 |
+
- [electrify_50_epochs.safetensors](./electrify_50_epochs.safetensors) - LoRA Model File
|
67 |
+
- [wan_img2vid_lora_workflow.json](./workflow_I2V/wan_img2vid_lora_workflow.json) - Wan I2V with LoRA Workflow for ComfyUI
|
68 |
+
|
69 |
+
---
|
70 |
+
<div style="background-color: #f8f9fa; padding: 20px; border-radius: 10px; margin-bottom: 20px;">
|
71 |
+
<div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
|
72 |
+
<h2 style="color: #24292e; margin-top: 0;">Recommended Settings</h2>
|
73 |
+
<ul style="margin-bottom: 0;">
|
74 |
+
<li><b>LoRA Strength:</b> 1.0</li>
|
75 |
+
<li><b>Embedded Guidance Scale:</b> 6.0</li>
|
76 |
+
<li><b>Flow Shift:</b> 5.0</li>
|
77 |
+
</ul>
|
78 |
+
</div>
|
79 |
+
|
80 |
+
<div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
|
81 |
+
<h2 style="color: #24292e; margin-top: 0;">Trigger Words</h2>
|
82 |
+
<p>The key trigger phrase is: <code style="background-color: #f0f0f0; padding: 3px 6px; border-radius: 4px;">e13c7r1c electricity effect</code></p>
|
83 |
+
</div>
|
84 |
+
|
85 |
+
<div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
|
86 |
+
<h2 style="color: #24292e; margin-top: 0;">Prompt Template</h2>
|
87 |
+
<p>For prompting, check out the example prompts; this way of prompting seems to work very well.</p>
|
88 |
+
|
89 |
+
|
90 |
+
<div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
|
91 |
+
<h2 style="color: #24292e; margin-top: 0;">ComfyUI Workflow</h2>
|
92 |
+
<p>This LoRA works with a modified version of <a href="https://github.com/kijai/ComfyUI-WanVideoWrapper/blob/main/example_workflows/wanvideo_480p_I2V_example_02.json" style="color: #0366d6; text-decoration: none;">Kijai's Wan Video Wrapper workflow</a>. The main modification is adding a Wan LoRA node connected to the base model.</p>
|
93 |
+
<img src="./workflow_I2V/workflow_screenshot.png" style="width: 100%; border-radius: 8px; margin: 15px 0; box-shadow: 0 4px 8px rgba(0,0,0,0.1);">
|
94 |
+
<p>See the Downloads section above for the modified workflow.</p>
|
95 |
+
</div>
|
96 |
+
</div>
|
97 |
+
|
98 |
+
<div style="background-color: #f8f9fa; padding: 20px; border-radius: 10px; margin-bottom: 20px;">
|
99 |
+
<div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
|
100 |
+
<h2 style="color: #24292e; margin-top: 0;">Model Information</h2>
|
101 |
+
<p>The model weights are available in Safetensors format. See the Downloads section above.</p>
|
102 |
+
</div>
|
103 |
+
|
104 |
+
<div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
|
105 |
+
<h2 style="color: #24292e; margin-top: 0;">Training Details</h2>
|
106 |
+
<ul style="margin-bottom: 0;">
|
107 |
+
<li><b>Base Model:</b> Wan2.1 14B I2V 480p</li>
|
108 |
+
<li><b>Training Data:</b> Trained on 25 seconds of video comprised of 13 short clips (each clip captioned separately) of various electricity clips</li>
|
109 |
+
<li><b> Epochs:</b> 50</li>
|
110 |
+
</ul>
|
111 |
+
</div>
|
112 |
+
|
113 |
+
<div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
|
114 |
+
<h2 style="color: #24292e; margin-top: 0;">Additional Information</h2>
|
115 |
+
<p>Training was done using <a href="https://github.com/tdrussell/diffusion-pipe" style="color: #0366d6; text-decoration: none;">Diffusion Pipe for Training</a></p>
|
116 |
+
</div>
|
117 |
+
|
118 |
+
<div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
|
119 |
+
<h2 style="color: #24292e; margin-top: 0;">Acknowledgments</h2>
|
120 |
+
<p style="margin-bottom: 0;">Special thanks to Kijai for the ComfyUI Wan Video Wrapper and tdrussell for the training scripts!</p>
|
121 |
+
</div>
|
122 |
+
</div>
|