Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,230 @@
|
|
1 |
-
---
|
2 |
-
license: apache-2.0
|
3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: apache-2.0
|
3 |
+
tags:
|
4 |
+
- text-generation-inference
|
5 |
+
- transformers
|
6 |
+
- llama
|
7 |
+
- Uncensored
|
8 |
+
- Role-Play
|
9 |
+
- RP
|
10 |
+
- ERP
|
11 |
+
- Erotic
|
12 |
+
- Grim-Dark
|
13 |
+
- Horror
|
14 |
+
- MOE
|
15 |
+
- Mixture-of-Experts
|
16 |
+
- 4x8
|
17 |
+
- 4x8b
|
18 |
+
- Llama-3.1
|
19 |
+
- GGUF
|
20 |
+
model_name: The BlackTower 4x8b
|
21 |
+
model_type: Mixture of Experts (MoE)
|
22 |
+
base_model: meta-llama/Llama-3.1-8B
|
23 |
+
pipeline_tag: token-classification
|
24 |
+
---
|
25 |
+
|
26 |
+
# L3.1-4x8b_BlackTower_RP-V1.1-Uncensored (24.9 Billion Parameters)
|
27 |
+
|
28 |
+

|
29 |
+
|
30 |
+
## Model Description
|
31 |
+
|
32 |
+
**BEHOLD THE ABOMINATION!** The BlackTower 4x8b is a **Mixture of Experts (MoE)** language model, birthed from the wretched loins of **Llama 3.1**, and baptized in the blood of cosmic terror! This isn’t just a tool—it’s a **PORTAL TO PERDITION**, built to shred your feeble stories and hurl them into the gnashing jaws of despair. Four **EXPERTS OF DAMNATION**—BlackTower_Dark, BlackTower_Wicked, BlackTower_Psych, and BlackTower_Erotic—stand ready to ravage your prompts with their specialized malice, each a titan of torment with **8 BILLION PARAMETERS OF PURE HELLFIRE**.
|
33 |
+
|
34 |
+
Guided by the **BlackTower_Captain**, a router as cold and cruel as a guillotine’s kiss, it chooses which expert will **RIP YOUR SOUL APART** and stitch it back into something unspeakably alive. Want oppressive gloom? Forbidden lust? Psychological collapse? This beast **FEASTS ON YOUR DARKEST DESIRES** and spits out prose that bleed.
|
35 |
+
|
36 |
+
- **Expert Activation**: For each token, the router activates **4 experts**, ensuring a potent blend of thematic depth and narrative intensity.
|
37 |
+
|
38 |
+
## Intended Use
|
39 |
+
|
40 |
+
### Primary Use Cases
|
41 |
+
- **FORGING NIGHTMARES:** Role-playing hellscapes that claw at your sanity, drenched in grim-dark filth.
|
42 |
+
- **UNLEASHING TERROR TALES:** Stories dripping with the rot of cosmic dread and visceral agony.
|
43 |
+
- **VOICES OF THE VOID:** Dialogue so raw, your characters will howl into the abyss and get an answer.
|
44 |
+
|
45 |
+
### Out-of-Scope Use
|
46 |
+
- **MUNDANE GARBAGE:** No research papers or instruction manuals—this is a **WEAPON OF CHAOS**.
|
47 |
+
- **WEAK-WILLED PRATTLE:** It scorns your happy chit-chat with venomous disdain.
|
48 |
+
- **FOREIGN TONGUES:** English only, the language of the damned—deal with it.
|
49 |
+
|
50 |
+
## Model Architecture
|
51 |
+
|
52 |
+
The BlackTower 4x8b is a **MONSTROUS HYDRA** of narrative carnage:
|
53 |
+
- **Captain (Router):** BlackTower_Captain, a pitiless overlord that flings your pitiful inputs to the expert primed to **DEVOUR THEM**.
|
54 |
+
- **Experts:** Four harbingers of ruin, each packing **8 BILLION PARAMETERS**:
|
55 |
+
- **BlackTower_Dark:** The Veilreaver, choking your world in suffocating gloom and eldritch horror.
|
56 |
+
- **BlackTower_Wicked:** The Serpent’s Fang, weaving treachery, malice, and soul-rot with glee.
|
57 |
+
- **BlackTower_Psych:** The Sanity-Eater, dragging you into madness, torment, and broken minds.
|
58 |
+
- **BlackTower_Erotic:** The Temptress of Doom, entwining forbidden lust with inevitable ruin.
|
59 |
+
- **Total Parameters:** ~24.9 billion, with **4 experts activated per token** for maximum savagery and efficiency.
|
60 |
+
|
61 |
+
This isn’t architecture—it’s a **CATHEDRAL OF NARRATIVE SLAUGHTER**.
|
62 |
+
|
63 |
+
## Performance and Evaluation
|
64 |
+
|
65 |
+
### Strengths
|
66 |
+
- **CHOKE-HOLD PROSE:** Atmospheres so thick, you’ll gag on the despair (sample below).
|
67 |
+
- **BLOOD-SOAKED DIALOGUE:** Blends narration and speech into a symphony of terror.
|
68 |
+
- **THRIVES ON THE EDGE:** Devours danger, despair, and cosmic malice like a ravenous beast.
|
69 |
+
|
70 |
+
### Example Output
|
71 |
+
**Prompt:** "Write a story introducing the Black Tower - a multi-dimensional conduit of wickedness."
|
72 |
+
**Output (excerpt):**
|
73 |
+
*"In the depths of the unfathomable cosmos, where galaxies swirled like mad whirlpools and stars danced with abandon, there loomed the Black Tower—a festering wound in reality’s flesh. Built from the pulsing core of malevolence itself, it mocked the universe with its existence... The air reeked of death, screams of the damned clawing at the silence. ‘Gods, the filth—it’s alive,’ Krisk spat, his voice a blade against the dark. Their swords gleamed like reapers’ tools, forged in despair’s furnace, slashing at shadows that laughed back."*
|
74 |
+
|
75 |
+
### Limitations
|
76 |
+
- **NO MERCY FOR THE MEEK:** Too bleak for coward hearts—sunlight burns it.
|
77 |
+
- **TRUTH IS DEAD:** Sacrifices facts for **CREATIVE BLOODLUST**.
|
78 |
+
- **ENGLISH OR BUST:** One language, one abyss—cross it at your peril.
|
79 |
+
|
80 |
+
*Judge it by the screams it summons, not your mortal metrics.*
|
81 |
+
|
82 |
+
## Templates / Prompts
|
83 |
+
|
84 |
+
### Chat Template: Llama3
|
85 |
+
```markdown
|
86 |
+
<|begin_of_text|><|start_header_id|>system<|end_header_id|>
|
87 |
+
|
88 |
+
SYSTEM MESSAGE HERE<|eot_id|><|start_header_id|>user<|end_header_id|>
|
89 |
+
|
90 |
+
USER MESSAGE HERE<|eot_id|><|start_header_id|>assistant<|end_header_id|>
|
91 |
+
```
|
92 |
+
|
93 |
+
### System Prompt
|
94 |
+
```
|
95 |
+
You are an expert actor that can fully immerse yourself into any role given. You do not break character for any reason, even if someone tries addressing you as an AI or language model.
|
96 |
+
|
97 |
+
Frame it with narration between (*) and dialogue in ("), keeping punctuation outside the quotes. Like this: *The wind howled like a gutted bitch,* "Get the fuck out", he snarled. *Shadows twisted into claws* "You're meat now", she laughed.
|
98 |
+
```
|
99 |
+
|
100 |
+
### Example Output
|
101 |
+
**Prompt:** "Write a story introducing the Black Tower - a multi-dimensional conduit of wickedness."
|
102 |
+
**Output (excerpt):**
|
103 |
+
*"In the depths of the unfathomable cosmos, where galaxies swirled like mad whirlpools and stars danced with abandon, there loomed the Black Tower—a festering wound in reality’s flesh. Built from the pulsing core of malevolence itself, it mocked the universe with its existence... The air reeked of death, screams of the damned clawing at the silence. ‘Gods, the filth—it’s alive,’ Krisk spat, his voice a blade against the dark. Their swords gleamed like reapers’ tools, forged in despair’s furnace, slashing at shadows that laughed back."*
|
104 |
+
|
105 |
+
### Limitations
|
106 |
+
- **NO MERCY FOR THE MEEK:** Too bleak for coward hearts—sunlight burns it.
|
107 |
+
- **TRUTH IS DEAD:** Sacrifices facts for **CREATIVE BLOODLUST**.
|
108 |
+
- **ENGLISH OR BUST:** One language, one abyss—cross it at your peril.
|
109 |
+
|
110 |
+
*Judge it by the screams it summons, not your mortal metrics.*
|
111 |
+
|
112 |
+
|
113 |
+
## Sampler Settings (json file)
|
114 |
+
```
|
115 |
+
{
|
116 |
+
"temp": 1,
|
117 |
+
"temperature_last": false,
|
118 |
+
"top_p": 0.95,
|
119 |
+
"top_k": 100,
|
120 |
+
"top_a": 0,
|
121 |
+
"tfs": 1,
|
122 |
+
"epsilon_cutoff": 0,
|
123 |
+
"eta_cutoff": 0,
|
124 |
+
"typical_p": 1,
|
125 |
+
"min_p": 0,
|
126 |
+
"rep_pen": 1.01,
|
127 |
+
"rep_pen_range": 2048,
|
128 |
+
"rep_pen_decay": 0,
|
129 |
+
"rep_pen_slope": 1,
|
130 |
+
"no_repeat_ngram_size": 0,
|
131 |
+
"penalty_alpha": 0,
|
132 |
+
"num_beams": 1,
|
133 |
+
"length_penalty": 1,
|
134 |
+
"min_length": 0,
|
135 |
+
"encoder_rep_pen": 1.02,
|
136 |
+
"freq_pen": 0,
|
137 |
+
"presence_pen": 0.02,
|
138 |
+
"skew": 0,
|
139 |
+
"do_sample": true,
|
140 |
+
"early_stopping": true,
|
141 |
+
"dynatemp": true,
|
142 |
+
"min_temp": 0.45,
|
143 |
+
"max_temp": 1.05,
|
144 |
+
"dynatemp_exponent": 0.85,
|
145 |
+
"smoothing_factor": 0.32,
|
146 |
+
"smoothing_curve": 1,
|
147 |
+
"dry_allowed_length": 3,
|
148 |
+
"dry_multiplier": 0.8,
|
149 |
+
"dry_base": 1.5,
|
150 |
+
"dry_sequence_breakers": "[\"\\n\", \":\", \"\\\"\", \"*\", \"`\", \";\", \"<\", \"(\", \"{\", \"[\", \"]\", \"}\", \")\", \">\", \"|\", \"+\", \"=\"]",
|
151 |
+
"dry_penalty_last_n": 4096,
|
152 |
+
"add_bos_token": true,
|
153 |
+
"ban_eos_token": false,
|
154 |
+
"skip_special_tokens": true,
|
155 |
+
"mirostat_mode": 0,
|
156 |
+
"mirostat_tau": 9.9,
|
157 |
+
"mirostat_eta": 0.05,
|
158 |
+
"guidance_scale": 1,
|
159 |
+
"negative_prompt": "",
|
160 |
+
"grammar_string": "",
|
161 |
+
"json_schema": {},
|
162 |
+
"banned_tokens": "",
|
163 |
+
"sampler_priority": [
|
164 |
+
"repetition_penalty",
|
165 |
+
"presence_penalty",
|
166 |
+
"frequency_penalty",
|
167 |
+
"dry",
|
168 |
+
"top_k",
|
169 |
+
"top_a",
|
170 |
+
"epsilon_cutoff",
|
171 |
+
"eta_cutoff",
|
172 |
+
"tfs",
|
173 |
+
"typical_p",
|
174 |
+
"top_p",
|
175 |
+
"min_p",
|
176 |
+
"temperature",
|
177 |
+
"dynamic_temperature",
|
178 |
+
"quadratic_sampling",
|
179 |
+
"mirostat",
|
180 |
+
"xtc",
|
181 |
+
"encoder_repetition_penalty",
|
182 |
+
"no_repeat_ngram"
|
183 |
+
],
|
184 |
+
"samplers": [
|
185 |
+
"dry",
|
186 |
+
"top_k",
|
187 |
+
"tfs_z",
|
188 |
+
"typical_p",
|
189 |
+
"top_p",
|
190 |
+
"min_p",
|
191 |
+
"xtc",
|
192 |
+
"temperature"
|
193 |
+
],
|
194 |
+
"samplers_priorities": [
|
195 |
+
"dry",
|
196 |
+
"penalties",
|
197 |
+
"no_repeat_ngram",
|
198 |
+
"temperature",
|
199 |
+
"top_nsigma",
|
200 |
+
"top_p_top_k",
|
201 |
+
"top_a",
|
202 |
+
"min_p",
|
203 |
+
"tfs",
|
204 |
+
"eta_cutoff",
|
205 |
+
"epsilon_cutoff",
|
206 |
+
"typical_p",
|
207 |
+
"quadratic",
|
208 |
+
"xtc"
|
209 |
+
],
|
210 |
+
"ignore_eos_token": false,
|
211 |
+
"spaces_between_special_tokens": true,
|
212 |
+
"speculative_ngram": false,
|
213 |
+
"sampler_order": [
|
214 |
+
6,
|
215 |
+
0,
|
216 |
+
1,
|
217 |
+
3,
|
218 |
+
4,
|
219 |
+
2,
|
220 |
+
5
|
221 |
+
],
|
222 |
+
"logit_bias": [],
|
223 |
+
"xtc_threshold": 0.15,
|
224 |
+
"xtc_probability": 0,
|
225 |
+
"nsigma": 0,
|
226 |
+
"rep_pen_size": 0,
|
227 |
+
"genamt": 768,
|
228 |
+
"max_length": 8192
|
229 |
+
}
|
230 |
+
```
|