AlexWortega commited on
Commit
495fb96
·
verified ·
1 Parent(s): 2822a33

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +23 -2
README.md CHANGED
@@ -8,13 +8,31 @@ tags:
8
  - video-to-video
9
  - diffusers
10
  ---
 
11
 
12
- # 🎥 CogvideoX-5b LoRa to control camera movement
 
 
 
 
 
13
 
14
  <video controls autoplay src="https://cdn-uploads.huggingface.co/production/uploads/63fde49f6315a264aba6a7ed/xyXfkrsbURSQOaPshPzob.mp4"></video>
15
 
16
  <video controls autoplay src="https://cdn-uploads.huggingface.co/production/uploads/63fde49f6315a264aba6a7ed/pwyqKU0xLHZ6TuUda7hez.mp4"></video>
17
 
 
 
 
 
 
 
 
 
 
 
 
 
18
  ### Usage
19
  The LoRa was trained to control camera movement in 6 directions: `left`, `right`, `up`, `down`, `zoom_in`, `zoom_out`.
20
  Start prompt with text like this:
@@ -26,6 +44,7 @@ Start prompt with text like this:
26
  ```
27
 
28
  ### Inference examples
 
29
  #### ComfyUI example
30
 
31
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/63fde49f6315a264aba6a7ed/xoCwk68lKPks0rrctHhvI.png)
@@ -74,4 +93,6 @@ export_to_video(video_generate, output_path, fps=8)
74
  Original code and models [CogVideoX](https://github.com/THUDM/CogVideo/tree/main).
75
 
76
  ## Contacts
77
- <p>Issues should be raised directly in the repository.</p>
 
 
 
8
  - video-to-video
9
  - diffusers
10
  ---
11
+ # 🎥 CogvideoX-5b LoRa: Camera Movement Control
12
 
13
+ ### 🚀 Try it here: [Interactive Demo](https://nim.video/create/2855fa68-21b1-4114-b366-53e5e4705ebf?workflow=image2video)
14
+
15
+ ---
16
+
17
+ ## Description
18
+ This LoRa (Low-Rank Adapter) model extends CogVideoX to control camera movement in 6 directions: `left`, `right`, `up`, `down`, `zoom_in`, and `zoom_out`. The LoRa can generate smooth camera motions for enhanced video creation.
19
 
20
  <video controls autoplay src="https://cdn-uploads.huggingface.co/production/uploads/63fde49f6315a264aba6a7ed/xyXfkrsbURSQOaPshPzob.mp4"></video>
21
 
22
  <video controls autoplay src="https://cdn-uploads.huggingface.co/production/uploads/63fde49f6315a264aba6a7ed/pwyqKU0xLHZ6TuUda7hez.mp4"></video>
23
 
24
+ ---
25
+
26
+
27
+ ## Usage
28
+
29
+ ### Prompt Format
30
+ Start your prompt with text like:
31
+ ```python
32
+ 'Camera moves to the {}...',
33
+ 'Camera is moving to the {}...',
34
+ '{} camera movement...',
35
+ '{} camera turn...',
36
  ### Usage
37
  The LoRa was trained to control camera movement in 6 directions: `left`, `right`, `up`, `down`, `zoom_in`, `zoom_out`.
38
  Start prompt with text like this:
 
44
  ```
45
 
46
  ### Inference examples
47
+
48
  #### ComfyUI example
49
 
50
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/63fde49f6315a264aba6a7ed/xoCwk68lKPks0rrctHhvI.png)
 
93
  Original code and models [CogVideoX](https://github.com/THUDM/CogVideo/tree/main).
94
 
95
  ## Contacts
96
+ <p>Issues should be raised directly in the repository.</p>
97
+
98
+