File size: 2,627 Bytes
57350c2 8be59df 57350c2 f8be430 3d5fa69 f8be430 aa9ecb3 57350c2 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 |
---
license: mit
tags:
- motion LoRA
- animatediff
- motion director
- LoRA
---
## Model Description
This repository contains a collection of basic camera motion LoRAs finetuned on Animatediff v2 models. The training process utilized Kijai's [AnimateDiff Motion Director ComfyUI nodes](https://github.com/kijai/ComfyUI-ADMotionDirector). These LoRAs have been tested exclusively in ComfyUI with Kosinkadink's [AnimateDiff-Evolved nodes](https://github.com/Kosinkadink/ComfyUI-AnimateDiff-Evolved), however they may be compatible with other AnimateDiff implementations.
## File summary
| Name | Compatible Motion Model | Base AR (w/h) | Frames | input videos |
| ------------------------------------------------------------- | ----------------------- | ------------- | ------ | ------------ |
| 16000_cseti_4507345_general-70vid_mv2.safetensors | v2 | (1:1) | 32 | 70 |
## How to use
- copy the motion lora files into your "ComfyUI\models\animatediff_motion_lora" folder
- Use the "Load Animatediff LoRA" node
- set the context_length parameter to 32 and context_overlap to 8 (it might work with other values but this is how I tested it)
## Settings and recommendations
- Use it with strength: 0.8
- This motion LoRA is finetuned on a v2 motion model. It works also with AnimateLCM but don't work with v3 models
- It works with SD 1.5 checkpoints
- Animatediff v3 adapter LoRA is recommended regardless it is a v2 model.
- If you want more motion try increasing the scale multival or lower the strength of the v3 adapter LoRA
- Try playing with the strength of
- motion LoRA
- scale multival
- v3_adapter lora
like increasing the scale multival and lowering the lora strength.
- I recommend using IP-Adapter, however it reduces the effect of the mLORAs, so play with the strength. "Ease in out" weight type is a good starting point.
## Examples
<video controls src="https://huggingface.co/Cseti/General_motionLoRA_32fr_sd15_ad2_v1/resolve/main/LoRA-comparison-us_00112.mp4" title="zoom in 32 frames"></video>
<video controls src="https://huggingface.co/Cseti/General_motionLoRA_32fr_sd15_ad2_v1/resolve/main/LoRA-comparison-us_00113.mp4" title="zoom in 32 frames"></video>
<video controls src="https://huggingface.co/Cseti/General_motionLoRA_32fr_sd15_ad2_v1/resolve/main/LoRA-comparison-us_00115.mp4" title="zoom in 32 frames"></video>
<video controls src="https://huggingface.co/Cseti/General_motionLoRA_32fr_sd15_ad2_v1/resolve/main/LoRA-comparison-us_00116.mp4" title="zoom in 32 frames"></video> |