Remade commited on
Commit
92e07c6
·
verified ·
1 Parent(s): 4ce1336

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +128 -0
README.md ADDED
@@ -0,0 +1,128 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ language:
4
+ - en
5
+ base_model:
6
+ - Wan-AI/Wan2.1-I2V-14B-480P
7
+ - Wan-AI/Wan2.1-I2V-14B-480P-Diffusers
8
+ pipeline_tag: image-to-video
9
+ tags:
10
+ - text-to-image
11
+ - lora
12
+ - diffusers
13
+ - template:diffusion-lora
14
+ - image-to-video
15
+ widget:
16
+ - text: >-
17
+ A biker, with a red bandana and black leather jacket, sits astride a motorcycle in a workshop. He looks at the camera with a serious expression. The camera performs an 0rb4it 360 degree orbit, circling around him and the motorcycle, showing the workshop interior including tools, before returning to the front view. Throughout the 0rb4it 360 degree orbit, the biker remains seated on the bike.
18
+ output:
19
+ url: example_videos/1.mp4
20
+ - text: >-
21
+ The video shows a meticulously assembled burger with floating ingredients. As the camera smoothly performs an 0rb4it 360 degree orbit, each element of the burger – the bun, lettuce, tomato slices, pickles, onion rings, bacon, cheese, and patty – slowly descends into place, one by one, to finish the burger. The camera completes the full rotation around the object
22
+ output:
23
+ url: example_videos/2.mp4
24
+ - text: >-
25
+ An elderly woman with a headscarf and a walking stick stands in a stone alleyway. The camera performs an 0rb4it 360 degree orbit, moving from the front towards the woman's profile, then passing her back, revealing the stone buildings in the background as it circles. As the camera moves, the woman slowly takes a step forward, continuing her walk.
26
+ output:
27
+ url: example_videos/3.mp4
28
+ ---
29
+
30
+ <div style="background-color: #f8f9fa; padding: 20px; border-radius: 10px; margin-bottom: 20px;">
31
+ <h1 style="color: #24292e; margin-top: 0;">360 Orbit LoRA for Wan2.1 14B I2V 480p</h1>
32
+
33
+ <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
34
+ <h2 style="color: #24292e; margin-top: 0;">Overview</h2>
35
+ <p>This LoRA is trained on the Wan2.1 14B I2V 480p model.It circles the camera smoothly around the subject, offering a full rotating view that adds energy and dimension. Ideal for dramatic reveals, product highlights, or showcasing a subject from all angles.
36
+
37
+
38
+ </p>
39
+ </div>
40
+
41
+ <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
42
+ <h2 style="color: #24292e; margin-top: 0;">Features</h2>
43
+ <ul style="margin-bottom: 0;">
44
+ <li>Trained on the Wan2.1 14B 480p I2V base model</li>
45
+ <li>Consistent results across different object types</li>
46
+ <li>Simple prompt structure that's easy to adapt</li>
47
+ </ul>
48
+ </div>
49
+
50
+ <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
51
+ <h2 style="color: #24292e; margin-top: 0;">Community</h2>
52
+ <ul style="margin-bottom: 0;">
53
+ <li>
54
+ Generate videos with 100+ Camera Control and VFX LoRAs on the
55
+ <a href="https://app.remade.ai/canvas/create" style="color: #0366d6; text-decoration: none;">Remade Canvas</a>.
56
+ </li>
57
+ <li>
58
+ <b>Discord:</b>
59
+ <a href="https://remade.ai/join-discord?utm_source=Huggingface&utm_medium=Social&utm_campaign=model_release&utm_content=360_orbit" style="color: #0366d6; text-decoration: none;">
60
+ Join our community
61
+ </a> to generate videos with this LoRA for free
62
+ </li>
63
+ </ul>
64
+ </div>
65
+
66
+ <Gallery />
67
+
68
+ # Model File and Inference Workflow
69
+
70
+ ## 📥 Download Links:
71
+
72
+ - [360_Orbit.safetensors](./360_Orbit.safetensors) - LoRA Model File
73
+ - [wan_img2vid_lora_workflow.json](./workflow_I2V/wan_img2vid_lora_workflow.json) - Wan I2V with LoRA Workflow for ComfyUI
74
+
75
+ ---
76
+ <div style="background-color: #f8f9fa; padding: 20px; border-radius: 10px; margin-bottom: 20px;">
77
+ <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
78
+ <h2 style="color: #24292e; margin-top: 0;">Recommended Settings</h2>
79
+ <ul style="margin-bottom: 0;">
80
+ <li><b>LoRA Strength:</b> 1.0</li>
81
+ <li><b>Embedded Guidance Scale:</b> 6.0</li>
82
+ <li><b>Flow Shift:</b> 5.0</li>
83
+ </ul>
84
+ </div>
85
+
86
+ <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
87
+ <h2 style="color: #24292e; margin-top: 0;">Trigger Words</h2>
88
+ <p>The key trigger phrase is: <code style="background-color: #f0f0f0; padding: 3px 6px; border-radius: 4px;">0rb4it 360 degree orbit</code></p>
89
+ </div>
90
+
91
+ <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
92
+ <h2 style="color: #24292e; margin-top: 0;">Prompt Template</h2>
93
+ <p>For prompting, check out the example prompts; this way of prompting seems to work very well.</p>
94
+
95
+
96
+ <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
97
+ <h2 style="color: #24292e; margin-top: 0;">ComfyUI Workflow</h2>
98
+ <p>This LoRA works with a modified version of <a href="https://github.com/kijai/ComfyUI-WanVideoWrapper/blob/main/example_workflows/wanvideo_480p_I2V_example_02.json" style="color: #0366d6; text-decoration: none;">Kijai's Wan Video Wrapper workflow</a>. The main modification is adding a Wan LoRA node connected to the base model.</p>
99
+ <img src="./workflow_I2V/workflow_screenshot.png" style="width: 100%; border-radius: 8px; margin: 15px 0; box-shadow: 0 4px 8px rgba(0,0,0,0.1);">
100
+ <p>See the Downloads section above for the modified workflow.</p>
101
+ </div>
102
+ </div>
103
+
104
+ <div style="background-color: #f8f9fa; padding: 20px; border-radius: 10px; margin-bottom: 20px;">
105
+ <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
106
+ <h2 style="color: #24292e; margin-top: 0;">Model Information</h2>
107
+ <p>The model weights are available in Safetensors format. See the Downloads section above.</p>
108
+ </div>
109
+
110
+ <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
111
+ <h2 style="color: #24292e; margin-top: 0;">Training Details</h2>
112
+ <ul style="margin-bottom: 0;">
113
+ <li><b>Base Model:</b> Wan2.1 14B I2V 480p</li>
114
+ <li><b>Training Data:</b> Trained on 50 seconds of video comprised of 10 short clips (each clip captioned separately) of the camera moving around various objects.</li>
115
+ <li><b> Epochs:</b> 30</li>
116
+ </ul>
117
+ </div>
118
+
119
+ <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
120
+ <h2 style="color: #24292e; margin-top: 0;">Additional Information</h2>
121
+ <p>Training was done using <a href="https://github.com/tdrussell/diffusion-pipe" style="color: #0366d6; text-decoration: none;">Diffusion Pipe for Training</a></p>
122
+ </div>
123
+
124
+ <div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
125
+ <h2 style="color: #24292e; margin-top: 0;">Acknowledgments</h2>
126
+ <p style="margin-bottom: 0;">Special thanks to Kijai for the ComfyUI Wan Video Wrapper and tdrussell for the training scripts!</p>
127
+ </div>
128
+ </div>