Remade-AI
/

Painting

+---
+license: apache-2.0
+language:
+- en
+base_model:
+- Wan-AI/Wan2.1-I2V-14B-480P
+- Wan-AI/Wan2.1-I2V-14B-480P-Diffusers
+pipeline_tag: image-to-video
+tags:
+- text-to-image
+- lora
+- diffusers
+- template:diffusion-lora
+- image-to-video
+widget:
+- text: >-
+      The video starts with a dog. The next scene shows the dog inside a gold framed mirror in a room. The dog is wearing the same clothes and the background outside the frame shows a landscape scene. Next, the dog transforms into a p41nt1ng painting frame it, where the dog is dressed in red and blue clothing. The background is an older style painting scene. Finally, the dog is in another p41nt1ng painting frame it, where it is dressed in a red robe with the same landscape background in the painting.
+  output:
+    url: example_videos/dog_painting.mp4
+- text: >-
+      The video starts with a woman. The next scene shows the woman inside a gold framed mirror in a room. She is wearing the same clothes and the background outside the frame shows a landscape scene. Next, the woman transforms into a p41nt1ng painting frame it, where she is dressed in red and blue clothing. The background is an older style painting scene. Finally, the woman is in another p41nt1ng painting frame it, where she is dressed in a red robe with the same landscape background in the painting.
+  output:
+    url: example_videos/woman_painting.mp4
+- text: >-
+      The video starts with a man. The next scene shows the man inside a gold framed mirror in a room. He is wearing the same clothes and the background outside the frame shows a landscape scene. Next, the man transforms into a p41nt1ng painting frame it, where he is dressed in red and blue clothing. The background is an older style painting scene. Finally, the man is in another p41nt1ng painting frame it, where he is dressed in a red robe with the same landscape background in the painting.
+  output:
+    url: example_videos/man_painting.mp4
+---
+<div style="background-color: #f8f9fa; padding: 20px; border-radius: 10px; margin-bottom: 20px;">
+  <h1 style="color: #24292e; margin-top: 0;">Historic Painting Effect LoRA for Wan2.1 14B I2V 480p</h1>
+  <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
+    <h2 style="color: #24292e; margin-top: 0;">Overview</h2>
+    <p>This LoRA is trained on the Wan2.1 14B I2V 480p model and allows you to make any person/object in an image become a historic painting version of themselves!</p>
+  </div>
+  <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
+    <h2 style="color: #24292e; margin-top: 0;">Features</h2>
+    <ul style="margin-bottom: 0;">
+      <li>Transform any image into a video of the subject as a historic painting version of themselves!</li>
+      <li>Trained on the Wan2.1 14B 480p I2V base model</li>
+      <li>Consistent results across different object types</li>
+      <li>Simple prompt structure that's easy to adapt</li>
+    </ul>
+  </div>
+  <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
+    <h2 style="color: #24292e; margin-top: 0;">Community</h2>
+    <ul style="margin-bottom: 0;">
+      <li><b>Discord:</b> <a href="https://discord.com/invite/7tsKMCbNFC" style="color: #0366d6; text-decoration: none;">Join our community</a> to generate videos with this LoRA for free</li>
+      <li><b>Request LoRAs:</b> We're training and open-sourcing Wan2.1 LoRAs for free - join our Discord to make requests!</li>
+    </ul>
+  </div>
+</div>
+<Gallery />
+# Model File and Inference Workflow
+## 📥 Download Links:
+- [painting_50_epochs.safetensors](./painting_50_epochs.safetensors) - LoRA Model File
+- [wan_I2V_LoRA_workflow.json](./wan_I2V_LoRA_workflow.json) - Wan I2V with LoRA Workflow for ComfyUI
+---
+<div style="background-color: #f8f9fa; padding: 20px; border-radius: 10px; margin-bottom: 20px;">
+  <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
+    <h2 style="color: #24292e; margin-top: 0;">Recommended Settings</h2>
+    <ul style="margin-bottom: 0;">
+      <li><b>LoRA Strength:</b> 1.0</li>
+      <li><b>Embedded Guidance Scale:</b> 6.0</li>
+      <li><b>Flow Shift:</b> 5.0</li>
+    </ul>
+  </div>
+  <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
+    <h2 style="color: #24292e; margin-top: 0;">Trigger Words</h2>
+    <p>The key trigger phrase is: <code style="background-color: #f0f0f0; padding: 3px 6px; border-radius: 4px;"> p41nt1ng painting frame it</code></p>
+  </div>
+  <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
+    <h2 style="color: #24292e; margin-top: 0;">Prompt Template</h2>
+    <p>For best results, try following the structure of the prompt examples above. These worked well for me.</p>
+  </div>
+  <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
+    <h2 style="color: #24292e; margin-top: 0;">ComfyUI Workflow</h2>
+    <p>This LoRA works with a modified version of <a href="https://github.com/kijai/ComfyUI-WanVideoWrapper/blob/main/example_workflows/wanvideo_480p_I2V_example_02.json" style="color: #0366d6; text-decoration: none;">Kijai's Wan Video Wrapper workflow</a>. The main modification is adding a Wan LoRA node connected to the base model.</p>
+    <p>See the Downloads section above for the modified workflow.</p>
+  </div>
+</div>
+<div style="background-color: #f8f9fa; padding: 20px; border-radius: 10px; margin-bottom: 20px;">
+  <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
+    <h2 style="color: #24292e; margin-top: 0;">Model Information</h2>
+    <p>The model weights are available in Safetensors format. See the Downloads section above.</p>
+  </div>
+  <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
+    <h2 style="color: #24292e; margin-top: 0;">Training Details</h2>
+    <ul style="margin-bottom: 0;">
+      <li><b>Base Model:</b> Wan2.1 14B I2V 480p</li>
+      <li><b>Training Data:</b> Trained on 35 seconds of video comprised of 7 short clips (each clip captioned separately) of people transforming into a painting version of themselves!</li>
+      <li><b>Epochs:</b> 50</li>
+    </ul>
+  </div>
+  <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
+    <h2 style="color: #24292e; margin-top: 0;">Additional Information</h2>
+    <p>Training was done using <a href="https://github.com/tdrussell/diffusion-pipe" style="color: #0366d6; text-decoration: none;">Diffusion Pipe for Training</a></p>
+  </div>
+  <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
+    <h2 style="color: #24292e; margin-top: 0;">Acknowledgments</h2>
+    <p style="margin-bottom: 0;">Special thanks to Kijai for the ComfyUI Wan Video Wrapper and tdrussell for the training scripts!</p>
+  </div>
+</div>