Diffusers
Safetensors
HamHugging commited on
Commit
b3e54c8
·
1 Parent(s): 75dbb60

initial upload

Browse files
CogVideoX1.5-5B-I2V-OmniVFX ADDED
@@ -0,0 +1 @@
 
 
1
+ /mnt/workspace/mfy/code/CogVideo/finetune/VFX_v5_cogvideo_sft/checkpoint-14000
README.md CHANGED
@@ -37,7 +37,7 @@ Download checkpoints from HuggingFace and put it in `checkpoints`.
37
 
38
  ## Omni-VFX dataset and prompt-guided VFX
39
 
40
- We have released the most comprehensive VFX dataset currently available on HuggingFace. The dataset primarily consists of three sources: assets from [Open-VFX dataset](https://arxiv.org/abs/2502.05979), distillations of VFX provided by [Remade-AI](https://huggingface.co/Remade-AI), and VFX videos created using FLF2V. Due to copyright restrictions, a small portion of the videos cannot be publicly shared. Additionally, we provide the CogVideoX1.5 model, fine-tuned on our Omni-VFX dataset. This model enables prompt-guided VFX video generation. The prompts are refered to `VFX-prompts.txt`.
41
 
42
  ```shell
43
  sh scripts/prompt_guided_VFX.sh # modify the prompt and input image
@@ -66,7 +66,7 @@ sh scripts/inference_omnieffects_multiVFX.sh
66
  </p>
67
 
68
  # Acknowledgement
69
- We would like to thank the authors of [CogVideoX](https://github.com/zai-org/CogVideo), [EasyControl](https://github.com/Xiaojiu-z/EasyControl) and [VFXCreator](https://arxiv.org/abs/2502.05979) for their outstanding work.
70
 
71
  # Citation
72
  ```
 
37
 
38
  ## Omni-VFX dataset and prompt-guided VFX
39
 
40
+ We have released the most comprehensive VFX dataset currently available on HuggingFace. The dataset primarily consists of three sources: assets from [Open-VFX dataset](https://huggingface.co/datasets/sophiaa/Open-VFX), distillations of VFX provided by [Remade-AI](https://huggingface.co/Remade-AI), and VFX videos created using FLF2V. Due to copyright restrictions, a small portion of the videos cannot be publicly shared. Additionally, we provide the CogVideoX1.5 model, fine-tuned on our Omni-VFX dataset. This model enables prompt-guided VFX video generation. The prompts are refered to `VFX-prompts.txt`.
41
 
42
  ```shell
43
  sh scripts/prompt_guided_VFX.sh # modify the prompt and input image
 
66
  </p>
67
 
68
  # Acknowledgement
69
+ We would like to thank the authors of [CogVideoX](https://github.com/zai-org/CogVideo), [EasyControl](https://github.com/Xiaojiu-z/EasyControl) and [VFXCreator](https://huggingface.co/datasets/sophiaa/Open-VFX) for their outstanding work.
70
 
71
  # Citation
72
  ```
multi-VFX/cond_lora.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:18f17153afc2d5612091252e268a13642e40aa66b014b79a3ef7b1cf97da979f
3
+ size 1597885284
multi-VFX/moe_lora.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c9e5fc3c4495898d580914874f42c3f3381f0a647b4606c3705653852050d92a
3
+ size 1589527201
multi-VFX/pytorch_lora_weights.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fba6a1d4238ae37b973f595bdf4b6399348c200d5edf82af86c35d940070d896
3
+ size 264286184