tavihalperin naomiKenKorem commited on
Commit
afb94b1
·
verified ·
1 Parent(s): 661504c

upload model card (#7)

Browse files

- upload model card (bfbc4ebd7b55f7e781ecff8c0ea15f96e91ed3a3)


Co-authored-by: ken korem <[email protected]>

.gitattributes CHANGED
@@ -33,3 +33,8 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ samples/sample_0.gif filter=lfs diff=lfs merge=lfs -text
37
+ samples/sample_1.gif filter=lfs diff=lfs merge=lfs -text
38
+ samples/sample_2.gif filter=lfs diff=lfs merge=lfs -text
39
+ samples/sample_3.gif filter=lfs diff=lfs merge=lfs -text
40
+ samples/sample_4.gif filter=lfs diff=lfs merge=lfs -text
LTX-Video-ICLoRA-pose-13b-0.9.7.txt ADDED
@@ -0,0 +1,2 @@
 
 
 
1
+ LTX-Video-ICLoRA-pose-13b-0.9.7 (�LTXV�)
2
+
README.md ADDED
@@ -0,0 +1,64 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - ltx-video
4
+ - image-to-video
5
+ pinned: true
6
+ language:
7
+ - en
8
+ license: other
9
+ pipeline_tag: text-to-video
10
+ library_name: diffusers
11
+ ---
12
+
13
+ # LTX Video ICLoRA Pose 13B 0.9.7
14
+
15
+ This is a pose control model on top of [`LTXV_13B_097_DEV`](https://huggingface.co/Lightricks/LTX-Video/blob/main/ltxv-13b-0.9.7-dev.safetensors) trained on custom data.
16
+
17
+ ## What is In-Context LoRA (IC LoRA)?
18
+
19
+ IC LoRA is a method that enables adding video context into the video generation process. This approach allows for video-to-video control on top of the text-to-video model, providing more precise control over the generated content by conditioning the model on reference video frames during inference.
20
+
21
+ comfy compatible model: [ltxv-097-ic-lora-pose-control-comfyui.safetensors](https://huggingface.co/Lightricks/LTX-Video-ICLoRA-pose-13b-0.9.7/blob/main/ltxv-097-ic-lora-pose-control-comfyui.safetensors)
22
+
23
+
24
+ diffusers compatible model:[ltxv-097-ic-lora-pose-control-diffusers.safetensors](https://huggingface.co/Lightricks/LTX-Video-ICLoRA-pose-13b-0.9.7/blob/main/ltxv-097-ic-lora-pose-control-diffusers.safetensors)
25
+
26
+ ## License
27
+
28
+ For licensing information, please refer to the [LTXV Open Weights License](LTX-Video-ICLoRA-pose-13b-0.9.7.txt).
29
+ ## Model Details
30
+
31
+ - **Base Model:** [`LTXV_13B_097_DEV`](https://huggingface.co/Lightricks/LTX-Video/blob/main/ltxv-13b-0.9.7-dev.safetensors)
32
+ - **Training Type:** IC LoRA training
33
+ - **Learning Rate:** 0.0002
34
+ - **Rank:** 24
35
+
36
+ ## Sample Outputs
37
+
38
+
39
+ | | | |
40
+ |:---:|:---:|:---:|
41
+ | ![example1](./samples/sample_0.gif) | ![example2](./samples/sample_1.gif) | ![example3](./samples/sample_2.gif) |
42
+
43
+ | | |
44
+ |:---:|:---:|
45
+ | ![example4](./samples/sample_3.gif) | ![example5](./samples/sample_4.gif) |
46
+
47
+ ## Usage
48
+
49
+ This model is designed to be used with the LTXV (Lightricks Text-to-Video) pipeline.
50
+
51
+ ### 🔌 Using Trained LoRAs in ComfyUI
52
+ In order to use the trained lora in comfy:
53
+ 1. Copy the comfyui trained LoRA weights to the `models/loras` folder in your ComfyUI installation.
54
+ 2. Use ic-lora-pose-control.json from [official LTXV ComfyUI repository](https://github.com/Lightricks/ComfyUI-LTXVideo)
55
+
56
+
57
+
58
+
59
+
60
+
61
+ ## Acknowledgments
62
+
63
+ - Base model by [Lightricks](https://huggingface.co/Lightricks)
64
+ - Training infrastructure: [LTX-Video-Trainer](https://github.com/Lightricks/ltx-video-trainer)
samples/sample_0.gif ADDED

Git LFS Details

  • SHA256: cbe0de95779e15113acbefc0bbbedf01f7ff7790e54624d7290a1624834faaaf
  • Pointer size: 133 Bytes
  • Size of remote file: 46.9 MB
samples/sample_1.gif ADDED

Git LFS Details

  • SHA256: 474ae21db87fac13676a7bd863698f38f940cf7aa0827af5054751d5f0812fcf
  • Pointer size: 133 Bytes
  • Size of remote file: 27.8 MB
samples/sample_2.gif ADDED

Git LFS Details

  • SHA256: cc93331f88c51e741ad1bacae097b252637dc29f4fcc1a689e6265391eea0831
  • Pointer size: 133 Bytes
  • Size of remote file: 45.3 MB
samples/sample_3.gif ADDED

Git LFS Details

  • SHA256: 4c4702180996ee9b55554ffad91f83d02242b40954fe5c15f9c1e52cbb43250b
  • Pointer size: 133 Bytes
  • Size of remote file: 42.3 MB
samples/sample_4.gif ADDED

Git LFS Details

  • SHA256: ac7a88e756ad15e04f645f69b3d8b4b0f2dd61a7ee39924f18f63ddfc8a926bf
  • Pointer size: 133 Bytes
  • Size of remote file: 10.3 MB