README.md

metadata

tags:
  - text-to-image
  - stable-diffusion
  - lora
  - diffusers
  - image-generation
  - flux
  - safetensors
widget:
  - text: >-
      Makoto Shinkai style, a boy and a girl looking out of a window with a cat
      perched on the window sill. There is a bicycle parked in front of them and
      a plant with flowers to the right side of the image. The wall behind them
      is visible in the background.
    output:
      url: images/example_1.png
  - text: >-
      Makoto Shinkai style, a girl in a green cloak walking alone through an
      ancient forest, sunlight piercing through towering trees like stained
      glass, glowing pollen swirling around her boots, a rusted lantern hanging
      from her wooden staff, shadows of deer spirits flickering between
      moss-covered stones, muted emerald and gold color palette
    output:
      url: images/example_2.png
  - text: >-
      Makoto Shinkai style, a shepherd boy floating on a wooly cloud-whale,
      holding a glowing dandelion staff to guide sheep-shaped cumulus, miniature
      storm clouds grazing nearby, his patched jacket flapping in high-altitude
      winds, aurora-like ribbons in peach and lavender stretching across the sky
    output:
      url: images/example_3.png
base_model: black-forest-labs/FLUX.1-dev
instance_prompt: Makoto Shinkai style
license: other
license_name: flux-1-dev-non-commercial-license
license_link: https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md

FLUX.1-dev-LoRA-Makoto-Shinkai

This is a Makoto Shinkai style LoRA trained on FLUX.1-dev.

Prompt

Makoto Shinkai style, a boy and a girl looking out of a window with a cat perched on the window sill. There is a bicycle parked in front of them and a plant with flowers to the right side of the image. The wall behind them is visible in the background.

Prompt

Makoto Shinkai style, a girl in a green cloak walking alone through an ancient forest, sunlight piercing through towering trees like stained glass, glowing pollen swirling around her boots, a rusted lantern hanging from her wooden staff, shadows of deer spirits flickering between moss-covered stones, muted emerald and gold color palette

Prompt

Makoto Shinkai style, a shepherd boy floating on a wooly cloud-whale, holding a glowing dandelion staff to guide sheep-shaped cumulus, miniature storm clouds grazing nearby, his patched jacket flapping in high-altitude winds, aurora-like ribbons in peach and lavender stretching across the sky

Trigger words

You should use Makoto Shinkai style to trigger the image generation.

Inference

import torch
from diffusers import FluxPipeline

pipe = FluxPipeline.from_pretrained("black-forest-labs/FLUX.1-dev", torch_dtype=torch.bfloat16)
pipe.load_lora_weights("InstantX/FLUX.1-dev-LoRA-Makoto-Shinkai", weight_name="Makoto_Shinkai_style.safetensors")
pipe.fuse_lora(lora_scale=1.0)
pipe.to("cuda")

prompt = "Makoto Shinkai style, a shepherd boy floating on a wooly cloud-whale, holding a glowing dandelion staff to guide sheep-shaped cumulus, miniature storm clouds grazing nearby, his patched jacket flapping in high-altitude winds, aurora-like ribbons in peach and lavender stretching across the sky"

image = pipe(prompt, 
             num_inference_steps=24, 
             guidance_scale=3.5,
             width=960, height=1280,
            ).images[0]
image.save(f"example.png")