HF Diffusers Conversion of the Consistency-V3-Flux-D1 model by AbstractPhila.
V3 Documentation (by AbstractPhila):
A longer version with more examples here.
Tested primarily on the FLUX.1 Dev e4m3fn at fp8, so the prepared checkpoint merge will reflect this value when its upload is complete.
https://civitai.com/models/670244/consistency-v3-flux1d-fp8t5vae
This runs on the base FLUX.1 Dev model, but it will work on other models, merges, and with other loras. The results will be mixed. Experiment with load order, as the model values shift in sequence in varying degrees.
This is nothing short of a spine to FLUX. It empowers useful tags very similar to danbooru, to establish camera control and assistance that makes it much easier to make very customizable characters in situations that FLUX likely CAN DO, but it requires a great deal more effort to do most of these situations by default.
I HIGHLY advise running a multiple loopback system to ensure image fidelity. Consistency improves quality and fidelity over multiple iterations.
This is HEAVILY individual oriented. However, due to the way I structured the resolutions, it can handle MANY people in similar situations. The loras that cause immediate change on the screen without context will often be completely useless, as they generally do nothing to contribute to the context.
The loras more specific to adding TRAITS to people or creating contextual interactions between people seem to work just fine.
Clothing works, hair types work, gender control works. Most of the loras I tested work, but there are some that do nothing.
This is not a merge. This is not a combination of loras. This lora was created using synthetic data generated from NAI and AutismPDXL over a period of a year. The image set is quite complex and the choice images used to create this one weren't easy to pick out. It took a lot of trial and error. Like an absolute ton of it.
There is a SERIES of core tags introduced with this lora. It adds an entire backbone to FLUX that it simply doesn't have by default. The activation pattern is complex, but if you build your character similar to NAI, it'll appear similar to how NAI creates characters.
The potential and power of this model isn't to be understated. This is absolute powerhouse of a lora and it's potential is beyond my scope.
It STILL can produce some abominations if you aren't careful. If you stick with standard prompting and you stick with a logical order, you should be building beautiful art in no time with it.
Resolutions are: 512, 768, 816, 1024, 1216
Suggested steps: 16
FLUX guidance: 4 or 3-5 if it's stubborn, 15+ if it's very stubborn
CFG: 1
I ran it with 2 loopbacks. The first being an upscale 1.05x and a denoise at 0.72-0.88, and the second being a denoise 0.8 almost never changed, depending how many traits I want introduced or removed.
CORE TAG POOL:
- anime - converts the styling of poses, characters, outfits, faces, and so on into anime
- realistic - converts the styling to realistic
- from front - a view from the front of a person, shoulder lined-up facing forward towards the viewer situation, where the center mass of the torso is facing the viewer.
- from side - a view from the side of a person, the shoulder vertical facing the viewer situation, where the shoulders are vertical meaning the character is from the side
- from behind - a view from directly behind the person
- straight-on - a straight-on vertical angling view, meant for a horizontal planar angle
- from above - a 45 to 90 degree tilt facing downward on an individual
- from below - a 45 to 90 degree tilt facing upward on an individual
- face - a face detail focused image, good for including face details specifically if they are stubborn
- full body - a full body view of an individual, good for more complex poses
- cowboy shot - the standard cowboy shot tag, works fairly well with anime, not so well with realism
- looking at viewer, looking to the side, looking ahead
- facing to the side, facing the viewer, facing away
- looking back, looking forward
Mixed tags create the intended mixed results, but they have mixed outcomes:
- from side, straight-on - a horizontal planar camera aimed at the side of individual or individuals
- from front, from above - 45 degree tilt facing downward from camera above front
- from side, from above - 45 degree tilt facing downward from camera above side
- from behind, from above - 45 degree tilt facing downward from camera above behind
- from front, from below
- from front, from above
- from front, straight-on
- from front, from side, from above
- from front from side, from below
- from front from side, straight-on
- from behind, from side, from above
- from behind, from side, from below
- from behind, from side, straight-on
- from side, from behind, from above
- from side, from behind, from below
- from side, from behind, straight-on
Those tags may seem similar, but the order will often create very distinctly different outcomes. Using the "from behind" tag ahead of the "from side" will, for example, weight the system towards "behind" rather than "side", but you'll often see the upper torso twisting and the body angling 45 degrees in either direction... The outcome is mixed, but it's definitely workable.
Traits, coloration, clothes, and so on also work:
- red hair, blue hair, green hair, white hair, black hair, gold hair, silver hair, blonde hair, brown hair, purple hair, pink hair, aqua hair
- red eyes, blue eyes, green eyes, white eyes, black eyes, gold eyes, silver eyes, yellow eyes, brown eyes, purple eyes, pink eyes, aqua eyes
- red latex bodysuit, blue latex bodysuit, green latex bodysuit, black latex bodysuit, white latex bodysuit, gold latex bodysuit, silver latex bodysuit, yellow latex bodysuit, brown latex bodysuit, purple latex bodysuit
- red bikini, blue bikini, green bikini, black bikini, white bikini, yellow bikini, brown bikini, purple bikini, pink bikini
- red dress, blue dress, green dress, black dress, white dress, yellow dress, brown dress, pink dress, purple dress
- skirts, shirts, dresses, necklaces, full outfits
- multiple materials; latex, metallic, denim, cotton, and so on Poses may or may not work in conjunction with the camera, may need tinkering:
- all fours
- kneeling
- lying
- lying, on back
- lying, on side
- lying, upside down
- kneeling, from behind
- kneeling, from front
- kneeling, from side
- squatting
- squatting, from behind
- squatting, from front
- squatting, from side Controlling legs and such can be really picky, so play with them a bit:
- legs
- legs together
- legs apart
- legs spread
- feet together
- feet apart
Hundreds of other tags used and included, millions of potential combinations!
Use them in conjunction ahead of any specifiers for a person's traits, but after the prompt for Flux itself.
- Downloads last month
- 8
Model tree for AlekseyCalvin/ConsistencyV3-Flux_Diffusers
Base model
black-forest-labs/FLUX.1-dev