---
license: other
license_link: LICENSE.md
library_name: diffusers
language:
- enf
pipeline_tag: text-to-image
tags:
- art
- diffusion
- aesthetic-poster-generation
---

<div align="center">
<h1>🎨 Imagine:<br/>Words To Visuals</h1>

[![GitHub](https://img.shields.io/badge/GitHub-Repository-blue)](https://github.com/skylinemusiccds/Imagine)
[![HuggingFace](https://img.shields.io/badge/🤗-HuggingFace-yellow)](https://huggingface.co/Satyam-Singh)
<!--[![Website](https://img.shields.io/badge/🌐-Website-green)](https://skylinemusiccds.github.io/Imagine/)
[![Video](https://img.shields.io/badge/🎥-Live_Demo-purple)](https://www.youtube.com/watch?v=92wMU4D7qx0)-->
[![HF Demo](https://img.shields.io/badge/🤗-HF_Demo-orange)](https://huggingface.co/spaces/Satyam-Singh/Imagine)

<img src="assets/logo2.png" alt="Imagine Logo" width="1000"/>

<img src="assets/teaser-1.png" alt="Imagine Logo" width="1000"/>

</div>

---


## 🌟 What is Imagine?

<div align="center">
<img src="assets/demo2.png" alt="What is Imagine - Quick Prompt Demo" width="1000"/>
<br>
</div>

**Imagine** is an all-in-one framework for creating **visually stunning posters**, blending:

- **Precise and accurate text rendering**
- **Seamless integration of abstract art**
- **Bold, eye-catching layouts**
- **A cohesive and harmonious visual style**


## 🚀 Quick Start

### 🔧 Installation

```bash
# Clone the repository
git clone https://github.com/skylinemusiccds/Imagine.git
cd Imagine

# Create conda environment
conda create -n imagine python=3.11
conda activate imagine

# Install dependencies
pip install -r requirements.txt

```

### 🚀 Easy Usage

**Imagine** offers a **modular and adaptable framework** that seamlessly fits into custom workflows or interoperates with other compatible systems. Its design prioritizes ease of use and flexibility, making integration effortless.


Loading the model is quick and intuitive:


```python
import torch
from diffusers import FluxPipeline, FluxTransformer2DModel

# 1. Define model IDs and settings
pipeline_id = "black-forest-labs/FLUX.1-dev"
imagine_transformer_id = "Satyam-Singh/Imagine" 
device = "cuda"
dtype = torch.bfloat16

# 2. Load the base pipeline
pipe = FluxPipeline.from_pretrained(pipeline_id, torch_dtype=dtype)

# 3. The key step: simply replace the original transformer with our Imagine model
pipe.transformer = FluxTransformer2DModel.from_pretrained(
    imagine_transformer_id, 
    torch_dtype=dtype
)
pipe.to(device)

# Now, `pipe` is a standard diffusers pipeline ready for inference with your own logic.

```

### 🚀 Quick Generation

For the best results, we recommend using the provided `inference.py` script, which includes our **intelligent prompt rewriting** feature. This enhancement automatically refines your input to generate more compelling and visually stunning results.

### Generate Posters with Precision

Create **high-quality aesthetic posters** from your prompt using `BF16` precision for improved performance and efficiency.

👉 Get started by visiting our [GitHub repository](https://github.com/skylinemusiccds/Imagine).

```bash
python inference.py \
  --prompt "Urban Canvas Street Art Expo poster with bold graffiti lettering and vibrant, dynamic color splashes capturing the energy of street art." \
  --enable_recap \
  --num_inference_steps 28 \
  --guidance_scale 3.5 \
  --seed 42 \
  --pipeline_path "black-forest-labs/FLUX.1-dev" \
  --custom_transformer_path "Satyam-Singh/Imagine" \
  --qwen_model_path "Qwen/Qwen3-8B"
```

If you are running on a GPU with limited memory, you can use `inference_offload.py` to offload some components to the CPU:

```bash
python inference_offload.py \
  --prompt "Urban Canvas Street Art Expo poster with bold graffiti lettering and vibrant, dynamic color splashes capturing the energy of street art." \
  --enable_recap \
  --num_inference_steps 28 \
  --guidance_scale 3.5 \
  --seed 42 \
  --pipeline_path "black-forest-labs/FLUX.1-dev" \
  --custom_transformer_path "Satyam-Singh/Imagine" \
  --qwen_model_path "Qwen/Qwen3-8B"
```


### 💻 Gradio Web UI

We provide a Gradio web UI for Imagine, please refer to our [GitHub repository](https://github.com/skylinemusiccds/Imagine). 

```bash
python demo_gradio.py
```


## 📊 Performance Benchmarks

<div align="center">

### 📈 Quantitative Results

<table>
<thead>
  <tr>
    <th>Method</th>
    <th>Text Recall ↑</th>
    <th>Text F-score ↑</th>
    <th>Text Accuracy ↑</th>
  </tr>
</thead>
<tbody>
  <tr>
    <td style="white-space: nowrap;">OpenCOLE (Open)</td>
    <td>0.082</td>
    <td>0.076</td>
    <td>0.061</td>
  </tr>
  <tr>
    <td style="white-space: nowrap;">Playground-v2.5 (Open)</td>
    <td>0.157</td>
    <td>0.146</td>
    <td>0.132</td>
  </tr>
  <tr>
    <td style="white-space: nowrap;">SD3.5 (Open)</td>
    <td>0.565</td>
    <td>0.542</td>
    <td>0.497</td>
  </tr>
  <tr>
    <td style="white-space: nowrap;">Flux1.dev (Open)</td>
    <td>0.723</td>
    <td>0.707</td>
    <td>0.667</td>
  </tr>
  <tr>
    <td style="white-space: nowrap;">Ideogram-v2 (Close)</td>
    <td>0.711</td>
    <td>0.685</td>
    <td>0.680</td>
  </tr>
  <tr>
    <td style="white-space: nowrap;">BAGEL (Open)</td>
    <td>0.543</td>
    <td>0.536</td>
    <td>0.463</td>
  </tr>
  <tr>
    <td style="white-space: nowrap;">Gemini2.0-Flash-Gen (Close)</td>
    <td>0.798</td>
    <td>0.786</td>
    <td>0.746</td>
  </tr>
  <tr>
    <td style="white-space: nowrap;"><b>Imagine (ours)</b></td>
    <td><b>0.787</b></td>
    <td><b>0.774</b></td>
    <td><b>0.735</b></td>
  </tr>
</tbody>
</table>


<img src="assets/hpc.png" alt="hpc" width="1000"/>

</div>


---

## 📝 Citation

If you find Imagine useful for your research, please cite our paper:

```bibtex
@article{LLaVA : !magine,
  title={LLaVA Imagine: Words to Visuals},
  author={Satyam Singh, UniVerse Ai},
  year={2025}
}
```

</div>