Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,128 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: apache-2.0
|
3 |
+
language:
|
4 |
+
- en
|
5 |
+
base_model:
|
6 |
+
- Wan-AI/Wan2.1-I2V-14B-480P
|
7 |
+
- Wan-AI/Wan2.1-I2V-14B-480P-Diffusers
|
8 |
+
pipeline_tag: image-to-video
|
9 |
+
tags:
|
10 |
+
- text-to-image
|
11 |
+
- lora
|
12 |
+
- diffusers
|
13 |
+
- template:diffusion-lora
|
14 |
+
- image-to-video
|
15 |
+
widget:
|
16 |
+
- text: >-
|
17 |
+
A woman in a white dress is walking across a large, reflective body of water with mountains in the background. The words "REMADE" are etched into the surface near the water. The cr4n3 crane up effect is applied, smoothly lifting the camera's viewpoint higher, revealing more of the surrounding landscape, including the shoreline and the vast expanse of water ahead as the woman continues walking into the distance.
|
18 |
+
output:
|
19 |
+
url: example_videos/1.mp4
|
20 |
+
- text: >-
|
21 |
+
Six monks in orange robes walk in a line along a stone path towards a large temple complex shrouded in mist. The scene is captured with a cr4n3 crane up effect, smoothly rising, revealing more of the temple's architectural details and the expanse of the courtyard as they continue to walk towards the temple in the distance.
|
22 |
+
output:
|
23 |
+
url: example_videos/2.mp4
|
24 |
+
- text: >-
|
25 |
+
In a dark, cavernous room, a young woman with red pigtails sits in a wooden chair, facing a wall of vintage televisions, each displaying a different moving image. The woman turns her head toward one of the screens, and then the cr4n3 crane up effect begins, smoothly lifting the camera's viewpoint higher. As the cr4n3 crane up effect continues, more of the room and the wall of televisions displaying varied scenes become visible, with the programs on the television screens reflecting off the wet floor.
|
26 |
+
output:
|
27 |
+
url: example_videos/3.mp4
|
28 |
+
---
|
29 |
+
|
30 |
+
<div style="background-color: #f8f9fa; padding: 20px; border-radius: 10px; margin-bottom: 20px;">
|
31 |
+
<h1 style="color: #24292e; margin-top: 0;">Crane up LoRA for Wan2.1 14B I2V 480p</h1>
|
32 |
+
|
33 |
+
<div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
|
34 |
+
<h2 style="color: #24292e; margin-top: 0;">Overview</h2>
|
35 |
+
<p>Lifts the camera smoothly upward to reveal a scene from above. Ideal for grand reveals, transitions, or adding cinematic elevation to a moment.This LoRA is trained on the Wan2.1 14B I2V 480p model.
|
36 |
+
|
37 |
+
|
38 |
+
</p>
|
39 |
+
</div>
|
40 |
+
|
41 |
+
<div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
|
42 |
+
<h2 style="color: #24292e; margin-top: 0;">Features</h2>
|
43 |
+
<ul style="margin-bottom: 0;">
|
44 |
+
<li>Trained on the Wan2.1 14B 480p I2V base model</li>
|
45 |
+
<li>Consistent results across different object types</li>
|
46 |
+
<li>Simple prompt structure that's easy to adapt</li>
|
47 |
+
</ul>
|
48 |
+
</div>
|
49 |
+
|
50 |
+
<div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
|
51 |
+
<h2 style="color: #24292e; margin-top: 0;">Community</h2>
|
52 |
+
<ul style="margin-bottom: 0;">
|
53 |
+
<li>
|
54 |
+
Generate videos with 100+ Camera Control and VFX LoRAs on the
|
55 |
+
<a href="https://app.remade.ai/canvas/create" style="color: #0366d6; text-decoration: none;">Remade Canvas</a>.
|
56 |
+
</li>
|
57 |
+
<li>
|
58 |
+
<b>Discord:</b>
|
59 |
+
<a href="https://remade.ai/join-discord?utm_source=Huggingface&utm_medium=Social&utm_campaign=model_release&utm_content=crane_up" style="color: #0366d6; text-decoration: none;">
|
60 |
+
Join our community
|
61 |
+
</a> to generate videos with this LoRA for free
|
62 |
+
</li>
|
63 |
+
</ul>
|
64 |
+
</div>
|
65 |
+
|
66 |
+
<Gallery />
|
67 |
+
|
68 |
+
# Model File and Inference Workflow
|
69 |
+
|
70 |
+
## 📥 Download Links:
|
71 |
+
|
72 |
+
- [Crane_up.safetensors](./Crane_up.safetensors) - LoRA Model File
|
73 |
+
- [wan_img2vid_lora_workflow.json](./workflow_I2V/wan_img2vid_lora_workflow.json) - Wan I2V with LoRA Workflow for ComfyUI
|
74 |
+
|
75 |
+
---
|
76 |
+
<div style="background-color: #f8f9fa; padding: 20px; border-radius: 10px; margin-bottom: 20px;">
|
77 |
+
<div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
|
78 |
+
<h2 style="color: #24292e; margin-top: 0;">Recommended Settings</h2>
|
79 |
+
<ul style="margin-bottom: 0;">
|
80 |
+
<li><b>LoRA Strength:</b> 1.0</li>
|
81 |
+
<li><b>Embedded Guidance Scale:</b> 6.0</li>
|
82 |
+
<li><b>Flow Shift:</b> 5.0</li>
|
83 |
+
</ul>
|
84 |
+
</div>
|
85 |
+
|
86 |
+
<div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
|
87 |
+
<h2 style="color: #24292e; margin-top: 0;">Trigger Words</h2>
|
88 |
+
<p>The key trigger phrase is: <code style="background-color: #f0f0f0; padding: 3px 6px; border-radius: 4px;">cr4n3 crane up effect</code></p>
|
89 |
+
</div>
|
90 |
+
|
91 |
+
<div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
|
92 |
+
<h2 style="color: #24292e; margin-top: 0;">Prompt Template</h2>
|
93 |
+
<p>For prompting, check out the example prompts; this way of prompting seems to work very well.</p>
|
94 |
+
|
95 |
+
|
96 |
+
<div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
|
97 |
+
<h2 style="color: #24292e; margin-top: 0;">ComfyUI Workflow</h2>
|
98 |
+
<p>This LoRA works with a modified version of <a href="https://github.com/kijai/ComfyUI-WanVideoWrapper/blob/main/example_workflows/wanvideo_480p_I2V_example_02.json" style="color: #0366d6; text-decoration: none;">Kijai's Wan Video Wrapper workflow</a>. The main modification is adding a Wan LoRA node connected to the base model.</p>
|
99 |
+
<img src="./workflow_I2V/workflow_screenshot.png" style="width: 100%; border-radius: 8px; margin: 15px 0; box-shadow: 0 4px 8px rgba(0,0,0,0.1);">
|
100 |
+
<p>See the Downloads section above for the modified workflow.</p>
|
101 |
+
</div>
|
102 |
+
</div>
|
103 |
+
|
104 |
+
<div style="background-color: #f8f9fa; padding: 20px; border-radius: 10px; margin-bottom: 20px;">
|
105 |
+
<div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
|
106 |
+
<h2 style="color: #24292e; margin-top: 0;">Model Information</h2>
|
107 |
+
<p>The model weights are available in Safetensors format. See the Downloads section above.</p>
|
108 |
+
</div>
|
109 |
+
|
110 |
+
<div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
|
111 |
+
<h2 style="color: #24292e; margin-top: 0;">Training Details</h2>
|
112 |
+
<ul style="margin-bottom: 0;">
|
113 |
+
<li><b>Base Model:</b> Wan2.1 14B I2V 480p</li>
|
114 |
+
<li><b>Training Data:</b> Trained on 50 seconds of video comprised of 10 short clips (each clip captioned separately) of scenes that used the Crane up camera motion .</li>
|
115 |
+
<li><b> Epochs:</b> 35</li>
|
116 |
+
</ul>
|
117 |
+
</div>
|
118 |
+
|
119 |
+
<div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
|
120 |
+
<h2 style="color: #24292e; margin-top: 0;">Additional Information</h2>
|
121 |
+
<p>Training was done using <a href="https://github.com/tdrussell/diffusion-pipe" style="color: #0366d6; text-decoration: none;">Diffusion Pipe for Training</a></p>
|
122 |
+
</div>
|
123 |
+
|
124 |
+
<div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
|
125 |
+
<h2 style="color: #24292e; margin-top: 0;">Acknowledgments</h2>
|
126 |
+
<p style="margin-bottom: 0;">Special thanks to Kijai for the ComfyUI Wan Video Wrapper and tdrussell for the training scripts!</p>
|
127 |
+
</div>
|
128 |
+
</div>
|