--- license: creativeml-openrail-m datasets: - FredZhang7/disco-diffusion tags: - text-to-image - stable-diffusion - disco-diffusion - painting - art inference: true --- ## Paint Journey V1 is Dreamlike Diffusion V1 fine-tuned on 260 hand-picked watercolor and digital paintings generated by [Disco Diffusion](https://github.com/alembics/disco-diffusion/blob/main/Disco_Diffusion.ipynb) Used Linux Dreambooth to teach the model to generate more artistic watercolor and digital paintings. Just use the same prompts you would for stable diffusion v1.5, but add **disco** at the start to use this style. To get started, try using dimensions around 768x768 for anything, 768x896 for portraits, and 1088x768 for landscapes. Or, you can stick with [Dreamlike Diffusion](https://huggingface.co/dreamlike-art/dreamlike-diffusion-1.0) dimensions. ## Professional Painting Check out [Paint Journey V2](https://huggingface.co/FredZhang7/paint-journey-v2)! Its artwork is characterized by intricate details, vibrant colors, and light that brings artwork to life. ## Portrait Examples ![](./example_discobeautifulyounglady_portrait.png) ![](./example_discoyoungman_portrait.png) ## Landscape Examples ![](./example_discofuturisticcity.png) ![](./example_discocityoilpainting.png) ![](./example_discolandneartheocean.png) ![](./example_discomountain_landscape.png) ## Outerspace Examples ![](./example_discoalienworld_landscape.png) ![](./example_discodreamlikeartgalaxy.png) ![](./example_discodreamlikeartuniverse.png) Prompts from top to bottom:
Click to expand ``` a disco painting of a happy young lady, gorgeous beautiful hair, ((beautiful eyes)), medium shot, high resolution wallpaper Negative prompt: low-res blurry deformed mutated body (((duplicate faces))) (((double head))) (((long neck))) bad anatomy long face extra fingers text watermark Steps: 40, Sampler: Euler a, CFG scale: 7.5, Seed: 895783426, Size: 768x928, Model hash: 4748ee4c, Batch size: 4, Batch pos: 0 ``` ``` a disco painting of a young man, smiling, beautiful eyes, half body, high resolution wallpaper Negative prompt: low-res blurry deformed mutated body ((duplicate faces)) ((double head)) bad anatomy long face long neck extra fingers text watermark signature Steps: 40, Sampler: Euler a, CFG scale: 7.5, Seed: 1616995491, Size: 768x936, Model hash: 4748ee4c, Batch size: 4, Batch pos: 0 ``` ``` ((disco futuristic city)), dreamlikeart, high resolution wallpaper Negative prompt: low-res blurry deformed fog Steps: 40, Sampler: Euler a, CFG scale: 7.5, Seed: 3950043173, Size: 768x768, Model hash: 4748ee4c, Batch size: 4, Batch pos: 0 ``` ``` disco city, oil and canvas painting, dreamlikeart, high resolution wallpaper Negative prompt: low-res blurry smoke Steps: 40, Sampler: Euler a, CFG scale: 7.5, Seed: 3015312670, Size: 768x768, Model hash: 4748ee4c, Batch size: 4, Batch pos: 0 ``` ``` disco land near the ocean, watercolor painting, sunset, high resolution wallpaper Negative prompt: low-res blurry deformed smoke Steps: 40, Sampler: Euler a, CFG scale: 7.5, Seed: 3299930008, Size: 1056x768, Model hash: 4748ee4c, Batch size: 4, Batch pos: 0 ``` ``` disco oil painting of a mountain, high resolution wallpaper Negative prompt: low-res blurry smoke Steps: 40, Sampler: Euler a, CFG scale: 7.5, Seed: 753552356, Size: 1056x768, Model hash: 4748ee4c, Batch size: 4, Batch pos: 0 ``` ``` disco beautiful landscape in an alien world, high resolution wallpaper Negative prompt: low-res blurry smoke Steps: 40, Sampler: Euler a, CFG scale: 7.5, Seed: 3582670051, Size: 1056x768, Model hash: 4748ee4c, Batch size: 4, Batch pos: 0 ``` ``` disco galaxy, dreamlikeart, high resolution wallpaper Negative prompt: low-res blurry smoke sphere Steps: 40, Sampler: Euler a, CFG scale: 7.5, Seed: 386090498, Size: 1056x768, Model hash: 4748ee4c, Batch size: 4, Batch pos: 0 ``` ``` disco universe, dreamlikeart, high resolution wallpaper Negative prompt: low-res blurry Steps: 40, Sampler: Euler a, CFG scale: 7.5, Seed: 2520017543, Size: 1056x768, Model hash: 4748ee4c, Batch size: 4, Batch pos: 0 ```

## Automatic1111's WebUI ``` git clone https://github.com/AUTOMATIC1111/stable-diffusion-webui.git ``` Download [paint_journey.ckpt](./paint_journey.ckpt) to the `./stable-diffusion-webui/models/Stable-diffusion` folder. Run `webui-user.bat`. ## Diffusers ```bash pip install --upgrade diffusers ``` ```python from diffusers import StableDiffusionPipeline import torch pipe = StableDiffusionPipeline.from_pretrained("FredZhang7/paint-journey-v1") pipe = pipe.to("cuda") prompt = "disco lighthouse near the sea, oil painting, high resolution wallpaper" image = pipe(prompt).images[0] image.save("./result.png") ``` ## Safety Checker The official [stable diffusion safety checker](https://huggingface.co/CompVis/stable-diffusion-safety-checker) uses up 1.22GB VRAM. Recommend using [Google Safesearch Mini](https://huggingface.co/FredZhang7/google-safesearch-mini) (99MB) to save 1.12GB VRAM.