|
--- |
|
tags: |
|
- text-to-image |
|
- stable-diffusion |
|
- lora |
|
- diffusers |
|
- image-generation |
|
- flux |
|
- safetensors |
|
widget: |
|
- text: >- |
|
Makoto Shinkai style, a boy and a girl looking out of a window with a cat |
|
perched on the window sill. There is a bicycle parked in front of them and a |
|
plant with flowers to the right side of the image. The wall behind them is |
|
visible in the background. |
|
output: |
|
url: images/example_1.png |
|
- text: >- |
|
Makoto Shinkai style, a girl in a green cloak walking alone through an |
|
ancient forest, sunlight piercing through towering trees like stained glass, |
|
glowing pollen swirling around her boots, a rusted lantern hanging from her |
|
wooden staff, shadows of deer spirits flickering between moss-covered |
|
stones, muted emerald and gold color palette |
|
output: |
|
url: images/example_2.png |
|
- text: >- |
|
Makoto Shinkai style, a shepherd boy floating on a wooly cloud-whale, |
|
holding a glowing dandelion staff to guide sheep-shaped cumulus, miniature |
|
storm clouds grazing nearby, his patched jacket flapping in high-altitude |
|
winds, aurora-like ribbons in peach and lavender stretching across the sky |
|
output: |
|
url: images/example_3.png |
|
base_model: black-forest-labs/FLUX.1-dev |
|
instance_prompt: Makoto Shinkai style |
|
license: other |
|
license_name: flux-1-dev-non-commercial-license |
|
license_link: https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md |
|
--- |
|
# FLUX.1-dev-LoRA-Makoto-Shinkai |
|
|
|
This is a Makoto Shinkai style LoRA trained on FLUX.1-dev. |
|
|
|
<Gallery /> |
|
|
|
|
|
## Trigger words |
|
|
|
You should use `Makoto Shinkai style` to trigger the image generation. |
|
|
|
|
|
## Inference |
|
```python |
|
import torch |
|
from diffusers import FluxPipeline |
|
|
|
pipe = FluxPipeline.from_pretrained("black-forest-labs/FLUX.1-dev", torch_dtype=torch.bfloat16) |
|
pipe.load_lora_weights("InstantX/FLUX.1-dev-LoRA-Makoto-Shinkai", weight_name="Makoto_Shinkai_style.safetensors") |
|
pipe.fuse_lora(lora_scale=1.0) |
|
pipe.to("cuda") |
|
|
|
prompt = "Makoto Shinkai style, a shepherd boy floating on a wooly cloud-whale, holding a glowing dandelion staff to guide sheep-shaped cumulus, miniature storm clouds grazing nearby, his patched jacket flapping in high-altitude winds, aurora-like ribbons in peach and lavender stretching across the sky" |
|
|
|
image = pipe(prompt, |
|
num_inference_steps=24, |
|
guidance_scale=3.5, |
|
width=960, height=1280, |
|
).images[0] |
|
image.save(f"example.png") |
|
``` |
|
|
|
|