Add a Basic Inference Script for the model

README.md

@@ -48,6 +48,40 @@ python ./inference.py --model_type fast
 ```
 > **Note:** The inference script will automatically download `meta-llama/Meta-Llama-3.1-8B-Instruct` model files. If you encounter network issues, you can download these files ahead of time and place them in the appropriate cache directory to avoid download failures during inference.
 
+## Basic Inference Script
+
+```python
+import torch
+from transformers import PreTrainedTokenizerFast, LlamaForCausalLM
+from diffusers import HiDreamImagePipeline
+tokenizer_4 = PreTrainedTokenizerFast.from_pretrained("meta-llama/Meta-Llama-3.1-8B-Instruct")
+text_encoder_4 = LlamaForCausalLM.from_pretrained(
+    "meta-llama/Meta-Llama-3.1-8B-Instruct",
+    output_hidden_states=True,
+    output_attentions=True,
+    torch_dtype=torch.bfloat16,
+)
+
+pipe = HiDreamImagePipeline.from_pretrained(
+    "HiDream-ai/HiDream-I1-Dev",  # "HiDream-ai/HiDream-I1-Dev" | "HiDream-ai/HiDream-I1-Fast"
+    tokenizer_4=tokenizer_4,
+    text_encoder_4=text_encoder_4,
+    torch_dtype=torch.bfloat16,
+)
+
+pipe = pipe.to('cuda')
+
+image = pipe(
+    'A cat holding a sign that says "HiDream.ai".',
+    height=1024,
+    width=1024,
+    guidance_scale=5.0,  # 0.0 for Dev&Fast
+    num_inference_steps=50,  # 28 for Dev and 16 for Fast
+    generator=torch.Generator("cuda").manual_seed(0),
+).images[0]
+image.save("output.png")
+```
+
 ## Gradio Demo
 
 We also provide a Gradio demo for interactive image generation. You can run the demo with: