CitronLegacy commited on
Commit
fae2112
·
verified ·
1 Parent(s): b29b266

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -141
README.md CHANGED
@@ -5,144 +5,5 @@ license: other
5
  license_name: fair-ai-public-license-1.0-sd
6
  license_link: https://freedevproject.org/faipl-1.0-sd/
7
  ---
8
- [中文版模型说明](https://huggingface.co/neta-art/Neta-Lumina/blob/main/README-ZH.md)
9
-
10
- ![image/png](https://cdn-uploads.huggingface.co/production/uploads/655319e00166ff6bd2351948/yp3wklEAT2JJ000dqqr1r.png)
11
-
12
- # Introduction
13
-
14
- **Neta Lumina** is a high‑quality anime‑style image‑generation model developed by Neta.art Lab.
15
- Building on the open‑source **Lumina‑Image‑2.0** released by the Alpha‑VLLM team at Shanghai AI Laboratory, we fine‑tuned the model with a vast corpus of high‑quality anime images and multilingual tag data. The preliminary result is a compelling model with powerful comprehension and interpretation abilities (thanks to Gemma text encoder), ideal for illustration, posters, storyboards, character design, and more.
16
-
17
- ## Key Features
18
-
19
- - Optimized for diverse creative scenarios such as Furry, Guofeng (traditional‑Chinese aesthetics), pets, etc.
20
- - Wide coverage of characters and styles, from popular to niche concepts. (Still support danbooru tags!)
21
- - Accurate natural‑language understanding with excellent adherence to complex prompts.
22
- - Native multilingual support, with Chinese, English, and Japanese recommended first.
23
-
24
- ## Model Versions
25
-
26
- For models in alpha tests, requst access at https://huggingface.co/neta-art/NetaLumina_Alpha if you are interested. We will keep updating.
27
-
28
-
29
- ### neta-lumina-beta-0624-raw
30
-
31
- - **Primary Goal**: General knowledge and anime‑style optimization
32
- - **Data Set**: >13 million anime‑style images
33
- - **>46,000** A100 Hours
34
- - Higher upper limit, suitable for pro users. Check [**Neta Lumina Prompt Book**](https://nieta-art.feishu.cn/wiki/RVBgwvzBqiCvQ7kOMm1cM6NdnNc) for better results.
35
-
36
- ### neta-lumina-beta-0624-aes-experimental
37
-
38
- - First beta release candidate
39
- - **Primary Goal**: Enhanced aesthetics, pose accuracy, and scene detail
40
- - **Data Set**: Hundreds of thousands of handpicked high‑quality anime images (fine‑tuned on an older version of raw model)
41
- - User-friendly, suitable for most people.
42
- <br>
43
-
44
- # How  to  Use
45
-
46
- [Try it at Hugging Face playground](https://huggingface.co/spaces/neta-art/NetaLumina_T2I_Playground)
47
-
48
- ## ComfyUI
49
- Neta Lumina is built on the **Lumina2 Diffusion Transformer (DiT)** framework, please follow these steps precisely.
50
-
51
- ### Environment Requirements
52
-
53
- Currently Neta Lumina runs only on ComfyUI:
54
- - Latest ComfyUI installation
55
- - ≥ 8 GB VRAM
56
-
57
- ### Downloads & Installation
58
-
59
- **Original (component) release**
60
-
61
- 1. **Neta Lumina-Beta**
62
- - Download link: https://huggingface.co/neta-art/Neta-Lumina/blob/main/Unet/neta-lumina-beta-aes-experimental-0624.safetensors
63
- - Save path: `ComfyUI/models/unet/`
64
- 2. **Text Encoder (Gemma-2B)**
65
- - Download link:https://huggingface.co/neta-art/Neta-Lumina/blob/main/Text%20Encoder/gemma_2_2b_fp16.safetensors
66
- - Save path: `ComfyUI/models/text_encoders/`
67
- 3. **VAE Model (16-Channel FLUX VAE)**
68
- - Download link: https://huggingface.co/neta-art/Neta-Lumina/blob/main/VAE/ae.safetensors
69
- - Save path: `ComfyUI/models/vae/`
70
-
71
- **Workflow**: load [`lumina_workflow.json`](https://huggingface.co/neta-art/Neta-Lumina/resolve/main/lumina_workflow.json) in ComfyUI.
72
-
73
- ![image/png](https://cdn-uploads.huggingface.co/production/uploads/655319e00166ff6bd2351948/XPWf7M1OE5DogKwNlnQIk.png)
74
-
75
- - `UNETLoader` – loads the `.pth`
76
- - `VAELoader` – loads `ae.safetensors`
77
- - `CLIPLoader` – loads `gemma_2_2b_fp16.safetensors`
78
- - `Text Encoder` – connects positive /negative prompts to K Sampler
79
-
80
- **Simple merged release**
81
- Download [`neta-lumina-beta-0624-all-in-one.safetensors`](https://huggingface.co/neta-art/Neta-Lumina/tree/main),
82
- `md5sum = dca54fef3c64e942c1a62a741c4f9d8a`,
83
- you may use ComfyUI’s simple checkpoint loader workflow.
84
-
85
- ### Recommended Settings
86
-
87
- - **Sampler**: `res_multistep`
88
- - **Scheduler**: `linear_quadratic`
89
- - **Steps**: 30
90
- - **CFG (guidance)**: 4 – 5.5
91
- - **EmptySD3LatentImage resolution**: 1024 × 1024, 768 × 1532, or 968 × 1322
92
- <br>
93
-
94
- # Prompt Book
95
-
96
- Detailed prompt guidelines: [**Neta Lumina Prompt Book**](https://nieta-art.feishu.cn/wiki/RVBgwvzBqiCvQ7kOMm1cM6NdnNc)
97
- <br>
98
-
99
- # Community
100
-
101
- - Discord: https://discord.com/invite/TTTGccjbEa
102
- - QQ group: 785779037
103
- <br>
104
-
105
- # Roadmap
106
-
107
- ## Model
108
-
109
- - Continous base‑model training to raise reasoning capability.
110
- - Aesthetic‑dataset iteration to improve anatomy, background richness, and overall appealness.
111
- - Smarter, more versatile tagging tools to lower the creative barrier.
112
-
113
- ## Ecosystem
114
-
115
- - LoRA training tutorials and components
116
- - Experienced users may already fine‑tune via Lumina‑Image‑2.0’s open code.
117
- - Development of advanced control / style‑consistency features (e.g., [Omini Control](https://arxiv.org/pdf/2411.15098)). [**Call for Collaboration!**](https://discord.com/invite/TTTGccjbEa)
118
- <br>
119
-
120
- # License & Disclaimer
121
-
122
- - Neta Lumina is released under the [**Fair AI Public License 1.0‑SD**](https://freedevproject.org/faipl-1.0-sd/)
123
- - Any modifications, merges, or derivative models must themselves be open‑sourced.
124
- <br>
125
-
126
- # Participants & Contributors
127
-
128
- - Special thanks to the **Alpha‑VLLM** team for open‑sourcing **Lumina‑Image‑2.0**
129
- - **Model development**: **Neta.art Lab (Civitai)**
130
- - Core Trainer: **li_li** [Civitai](https://civitai.com/user/li_li) ・ [Hugging Face](https://huggingface.co/heziiiii)
131
- <br>
132
- - **Partners**
133
- - **nebulae**: [Civitai](https://civitai.com/user/kitarz) ・ [Hugging Face](https://huggingface.co/NebulaeWis)
134
- - [**narugo1992**](https://github.com/narugo1992) & [**deepghs**](https://huggingface.co/deepghs): open datasets, processing tools, and models
135
- - [**Naifu**](https://github.com/Mikubill/naifu) trainer at [Mikubill](https://github.com/Mikubill)
136
- <br>
137
-
138
- # Community Contributors
139
-
140
- **Evaluators & developers**: 二小姐, spawner, Rnglg2
141
- **Other contributors**: 沉迷摸鱼, poi氵, ashan, 十分无奈, GHOSTLXH, wenaka, iiiiii, 年糕特工队, 恩匹希, 奶冻美宣集, mumu, yizyin, smile
142
- <br>
143
-
144
- # Appendix & Resources
145
-
146
- - **TeaCache**: https://github.com/spawner1145/CUI-Lumina2-TeaCache
147
- - **Advanced samplers & TeaCache guide (by spawner)**: https://docs.qq.com/doc/DZEFKb1ZrZVZiUmxw?nlc=1
148
- - **Neta Lumina ComfyUI Manual (in Chinese)**: https://docs.qq.com/doc/DZEVQZFdtaERPdXVh
 
5
  license_name: fair-ai-public-license-1.0-sd
6
  license_link: https://freedevproject.org/faipl-1.0-sd/
7
  ---
8
+ Support the original:
9
+ Forked from here https://huggingface.co/neta-art/Neta-Lumina