Commit
·
b3e54c8
1
Parent(s):
75dbb60
initial upload
Browse files- CogVideoX1.5-5B-I2V-OmniVFX +1 -0
- README.md +2 -2
- multi-VFX/cond_lora.pth +3 -0
- multi-VFX/moe_lora.pth +3 -0
- multi-VFX/pytorch_lora_weights.safetensors +3 -0
CogVideoX1.5-5B-I2V-OmniVFX
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
/mnt/workspace/mfy/code/CogVideo/finetune/VFX_v5_cogvideo_sft/checkpoint-14000
|
README.md
CHANGED
|
@@ -37,7 +37,7 @@ Download checkpoints from HuggingFace and put it in `checkpoints`.
|
|
| 37 |
|
| 38 |
## Omni-VFX dataset and prompt-guided VFX
|
| 39 |
|
| 40 |
-
We have released the most comprehensive VFX dataset currently available on HuggingFace. The dataset primarily consists of three sources: assets from [Open-VFX dataset](https://
|
| 41 |
|
| 42 |
```shell
|
| 43 |
sh scripts/prompt_guided_VFX.sh # modify the prompt and input image
|
|
@@ -66,7 +66,7 @@ sh scripts/inference_omnieffects_multiVFX.sh
|
|
| 66 |
</p>
|
| 67 |
|
| 68 |
# Acknowledgement
|
| 69 |
-
We would like to thank the authors of [CogVideoX](https://github.com/zai-org/CogVideo), [EasyControl](https://github.com/Xiaojiu-z/EasyControl) and [VFXCreator](https://
|
| 70 |
|
| 71 |
# Citation
|
| 72 |
```
|
|
|
|
| 37 |
|
| 38 |
## Omni-VFX dataset and prompt-guided VFX
|
| 39 |
|
| 40 |
+
We have released the most comprehensive VFX dataset currently available on HuggingFace. The dataset primarily consists of three sources: assets from [Open-VFX dataset](https://huggingface.co/datasets/sophiaa/Open-VFX), distillations of VFX provided by [Remade-AI](https://huggingface.co/Remade-AI), and VFX videos created using FLF2V. Due to copyright restrictions, a small portion of the videos cannot be publicly shared. Additionally, we provide the CogVideoX1.5 model, fine-tuned on our Omni-VFX dataset. This model enables prompt-guided VFX video generation. The prompts are refered to `VFX-prompts.txt`.
|
| 41 |
|
| 42 |
```shell
|
| 43 |
sh scripts/prompt_guided_VFX.sh # modify the prompt and input image
|
|
|
|
| 66 |
</p>
|
| 67 |
|
| 68 |
# Acknowledgement
|
| 69 |
+
We would like to thank the authors of [CogVideoX](https://github.com/zai-org/CogVideo), [EasyControl](https://github.com/Xiaojiu-z/EasyControl) and [VFXCreator](https://huggingface.co/datasets/sophiaa/Open-VFX) for their outstanding work.
|
| 70 |
|
| 71 |
# Citation
|
| 72 |
```
|
multi-VFX/cond_lora.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:18f17153afc2d5612091252e268a13642e40aa66b014b79a3ef7b1cf97da979f
|
| 3 |
+
size 1597885284
|
multi-VFX/moe_lora.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c9e5fc3c4495898d580914874f42c3f3381f0a647b4606c3705653852050d92a
|
| 3 |
+
size 1589527201
|
multi-VFX/pytorch_lora_weights.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:fba6a1d4238ae37b973f595bdf4b6399348c200d5edf82af86c35d940070d896
|
| 3 |
+
size 264286184
|