metadata

tags:
  - text-to-image
  - lora
  - diffusers
  - template:diffusion-lora
base_model: black-forest-labs/FLUX.1-Kontext-dev
instance_prompt: null
license: apache-2.0
pipeline_tag: image-to-image

RefControl Flux Kontext – Reference Canny LoRA

📝 Short description

A LoRA for Flux Kontext Dev that fuses a reference image (left) with a canny edge map (right).
It preserves identity and style from the reference while following the edges and outlines from the control.

Trigger word: refcontrolcanny

Demo video

📊 Examples

Reference	Result

📖 Extended description

This LoRA was primarily trained on humans and characters, but it works with objects and scenes as well.
The main purpose is to preserve identity — facial features, clothing, style — from the reference image, while using the canny edge map to define contours, composition, and layout.

⚙️ How to use

Concatenate two images side by side:
- Left: reference image (person, character, or object).
- Right: canny edges (line structure).
Add the trigger word refcontrolcanny in your prompt.
Adjust LoRA weight (recommended 0.8–1.0) depending on how strictly you want to follow edges.

✅ Example prompt

refcontrolcanny, change canny edges to photo with reference from left

🎯 What it does

Preserves style and identity of the reference.
Uses canny edges to control structure, outline, and composition.
Produces consistent results across different poses and layouts.

⚡ Tips

Works best if the canny map captures clean edges with minimal noise.

📌 Use cases

Character consistency in illustrations and comics.
Stylized redraws of objects with sharp outlines.
Scene composition based on silhouettes.
Rapid prototyping of layouts and storyboards.