Update README.md
Browse files
README.md
CHANGED
@@ -8,13 +8,31 @@ tags:
|
|
8 |
- video-to-video
|
9 |
- diffusers
|
10 |
---
|
|
|
11 |
|
12 |
-
|
|
|
|
|
|
|
|
|
|
|
13 |
|
14 |
<video controls autoplay src="https://cdn-uploads.huggingface.co/production/uploads/63fde49f6315a264aba6a7ed/xyXfkrsbURSQOaPshPzob.mp4"></video>
|
15 |
|
16 |
<video controls autoplay src="https://cdn-uploads.huggingface.co/production/uploads/63fde49f6315a264aba6a7ed/pwyqKU0xLHZ6TuUda7hez.mp4"></video>
|
17 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
18 |
### Usage
|
19 |
The LoRa was trained to control camera movement in 6 directions: `left`, `right`, `up`, `down`, `zoom_in`, `zoom_out`.
|
20 |
Start prompt with text like this:
|
@@ -26,6 +44,7 @@ Start prompt with text like this:
|
|
26 |
```
|
27 |
|
28 |
### Inference examples
|
|
|
29 |
#### ComfyUI example
|
30 |
|
31 |

|
@@ -74,4 +93,6 @@ export_to_video(video_generate, output_path, fps=8)
|
|
74 |
Original code and models [CogVideoX](https://github.com/THUDM/CogVideo/tree/main).
|
75 |
|
76 |
## Contacts
|
77 |
-
<p>Issues should be raised directly in the repository.</p>
|
|
|
|
|
|
8 |
- video-to-video
|
9 |
- diffusers
|
10 |
---
|
11 |
+
# 🎥 CogvideoX-5b LoRa: Camera Movement Control
|
12 |
|
13 |
+
### 🚀 Try it here: [Interactive Demo](https://nim.video/create/2855fa68-21b1-4114-b366-53e5e4705ebf?workflow=image2video)
|
14 |
+
|
15 |
+
---
|
16 |
+
|
17 |
+
## Description
|
18 |
+
This LoRa (Low-Rank Adapter) model extends CogVideoX to control camera movement in 6 directions: `left`, `right`, `up`, `down`, `zoom_in`, and `zoom_out`. The LoRa can generate smooth camera motions for enhanced video creation.
|
19 |
|
20 |
<video controls autoplay src="https://cdn-uploads.huggingface.co/production/uploads/63fde49f6315a264aba6a7ed/xyXfkrsbURSQOaPshPzob.mp4"></video>
|
21 |
|
22 |
<video controls autoplay src="https://cdn-uploads.huggingface.co/production/uploads/63fde49f6315a264aba6a7ed/pwyqKU0xLHZ6TuUda7hez.mp4"></video>
|
23 |
|
24 |
+
---
|
25 |
+
|
26 |
+
|
27 |
+
## Usage
|
28 |
+
|
29 |
+
### Prompt Format
|
30 |
+
Start your prompt with text like:
|
31 |
+
```python
|
32 |
+
'Camera moves to the {}...',
|
33 |
+
'Camera is moving to the {}...',
|
34 |
+
'{} camera movement...',
|
35 |
+
'{} camera turn...',
|
36 |
### Usage
|
37 |
The LoRa was trained to control camera movement in 6 directions: `left`, `right`, `up`, `down`, `zoom_in`, `zoom_out`.
|
38 |
Start prompt with text like this:
|
|
|
44 |
```
|
45 |
|
46 |
### Inference examples
|
47 |
+
|
48 |
#### ComfyUI example
|
49 |
|
50 |

|
|
|
93 |
Original code and models [CogVideoX](https://github.com/THUDM/CogVideo/tree/main).
|
94 |
|
95 |
## Contacts
|
96 |
+
<p>Issues should be raised directly in the repository.</p>
|
97 |
+
|
98 |
+
|