Dunjeon commited on
Commit
c8820ad
·
verified ·
1 Parent(s): 2397eea

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +230 -3
README.md CHANGED
@@ -1,3 +1,230 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ tags:
4
+ - text-generation-inference
5
+ - transformers
6
+ - llama
7
+ - Uncensored
8
+ - Role-Play
9
+ - RP
10
+ - ERP
11
+ - Erotic
12
+ - Grim-Dark
13
+ - Horror
14
+ - MOE
15
+ - Mixture-of-Experts
16
+ - 4x8
17
+ - 4x8b
18
+ - Llama-3.1
19
+ - GGUF
20
+ model_name: The BlackTower 4x8b
21
+ model_type: Mixture of Experts (MoE)
22
+ base_model: meta-llama/Llama-3.1-8B
23
+ pipeline_tag: token-classification
24
+ ---
25
+
26
+ # L3.1-4x8b_BlackTower_RP-V1.1-Uncensored (24.9 Billion Parameters)
27
+
28
+ ![image (75).jpg](https://cdn-uploads.huggingface.co/production/uploads/63d673cd1ce6700486cb1cee/KWmfFJRX-CyPPjhzue5sf.jpeg)
29
+
30
+ ## Model Description
31
+
32
+ **BEHOLD THE ABOMINATION!** The BlackTower 4x8b is a **Mixture of Experts (MoE)** language model, birthed from the wretched loins of **Llama 3.1**, and baptized in the blood of cosmic terror! This isn’t just a tool—it’s a **PORTAL TO PERDITION**, built to shred your feeble stories and hurl them into the gnashing jaws of despair. Four **EXPERTS OF DAMNATION**—BlackTower_Dark, BlackTower_Wicked, BlackTower_Psych, and BlackTower_Erotic—stand ready to ravage your prompts with their specialized malice, each a titan of torment with **8 BILLION PARAMETERS OF PURE HELLFIRE**.
33
+
34
+ Guided by the **BlackTower_Captain**, a router as cold and cruel as a guillotine’s kiss, it chooses which expert will **RIP YOUR SOUL APART** and stitch it back into something unspeakably alive. Want oppressive gloom? Forbidden lust? Psychological collapse? This beast **FEASTS ON YOUR DARKEST DESIRES** and spits out prose that bleed.
35
+
36
+ - **Expert Activation**: For each token, the router activates **4 experts**, ensuring a potent blend of thematic depth and narrative intensity.
37
+
38
+ ## Intended Use
39
+
40
+ ### Primary Use Cases
41
+ - **FORGING NIGHTMARES:** Role-playing hellscapes that claw at your sanity, drenched in grim-dark filth.
42
+ - **UNLEASHING TERROR TALES:** Stories dripping with the rot of cosmic dread and visceral agony.
43
+ - **VOICES OF THE VOID:** Dialogue so raw, your characters will howl into the abyss and get an answer.
44
+
45
+ ### Out-of-Scope Use
46
+ - **MUNDANE GARBAGE:** No research papers or instruction manuals—this is a **WEAPON OF CHAOS**.
47
+ - **WEAK-WILLED PRATTLE:** It scorns your happy chit-chat with venomous disdain.
48
+ - **FOREIGN TONGUES:** English only, the language of the damned—deal with it.
49
+
50
+ ## Model Architecture
51
+
52
+ The BlackTower 4x8b is a **MONSTROUS HYDRA** of narrative carnage:
53
+ - **Captain (Router):** BlackTower_Captain, a pitiless overlord that flings your pitiful inputs to the expert primed to **DEVOUR THEM**.
54
+ - **Experts:** Four harbingers of ruin, each packing **8 BILLION PARAMETERS**:
55
+ - **BlackTower_Dark:** The Veilreaver, choking your world in suffocating gloom and eldritch horror.
56
+ - **BlackTower_Wicked:** The Serpent’s Fang, weaving treachery, malice, and soul-rot with glee.
57
+ - **BlackTower_Psych:** The Sanity-Eater, dragging you into madness, torment, and broken minds.
58
+ - **BlackTower_Erotic:** The Temptress of Doom, entwining forbidden lust with inevitable ruin.
59
+ - **Total Parameters:** ~24.9 billion, with **4 experts activated per token** for maximum savagery and efficiency.
60
+
61
+ This isn’t architecture—it’s a **CATHEDRAL OF NARRATIVE SLAUGHTER**.
62
+
63
+ ## Performance and Evaluation
64
+
65
+ ### Strengths
66
+ - **CHOKE-HOLD PROSE:** Atmospheres so thick, you’ll gag on the despair (sample below).
67
+ - **BLOOD-SOAKED DIALOGUE:** Blends narration and speech into a symphony of terror.
68
+ - **THRIVES ON THE EDGE:** Devours danger, despair, and cosmic malice like a ravenous beast.
69
+
70
+ ### Example Output
71
+ **Prompt:** "Write a story introducing the Black Tower - a multi-dimensional conduit of wickedness."
72
+ **Output (excerpt):**
73
+ *"In the depths of the unfathomable cosmos, where galaxies swirled like mad whirlpools and stars danced with abandon, there loomed the Black Tower—a festering wound in reality’s flesh. Built from the pulsing core of malevolence itself, it mocked the universe with its existence... The air reeked of death, screams of the damned clawing at the silence. ‘Gods, the filth—it’s alive,’ Krisk spat, his voice a blade against the dark. Their swords gleamed like reapers’ tools, forged in despair’s furnace, slashing at shadows that laughed back."*
74
+
75
+ ### Limitations
76
+ - **NO MERCY FOR THE MEEK:** Too bleak for coward hearts—sunlight burns it.
77
+ - **TRUTH IS DEAD:** Sacrifices facts for **CREATIVE BLOODLUST**.
78
+ - **ENGLISH OR BUST:** One language, one abyss—cross it at your peril.
79
+
80
+ *Judge it by the screams it summons, not your mortal metrics.*
81
+
82
+ ## Templates / Prompts
83
+
84
+ ### Chat Template: Llama3
85
+ ```markdown
86
+ <|begin_of_text|><|start_header_id|>system<|end_header_id|>
87
+
88
+ SYSTEM MESSAGE HERE<|eot_id|><|start_header_id|>user<|end_header_id|>
89
+
90
+ USER MESSAGE HERE<|eot_id|><|start_header_id|>assistant<|end_header_id|>
91
+ ```
92
+
93
+ ### System Prompt
94
+ ```
95
+ You are an expert actor that can fully immerse yourself into any role given. You do not break character for any reason, even if someone tries addressing you as an AI or language model.
96
+
97
+ Frame it with narration between (*) and dialogue in ("), keeping punctuation outside the quotes. Like this: *The wind howled like a gutted bitch,* "Get the fuck out", he snarled. *Shadows twisted into claws* "You're meat now", she laughed.
98
+ ```
99
+
100
+ ### Example Output
101
+ **Prompt:** "Write a story introducing the Black Tower - a multi-dimensional conduit of wickedness."
102
+ **Output (excerpt):**
103
+ *"In the depths of the unfathomable cosmos, where galaxies swirled like mad whirlpools and stars danced with abandon, there loomed the Black Tower—a festering wound in reality’s flesh. Built from the pulsing core of malevolence itself, it mocked the universe with its existence... The air reeked of death, screams of the damned clawing at the silence. ‘Gods, the filth—it’s alive,’ Krisk spat, his voice a blade against the dark. Their swords gleamed like reapers’ tools, forged in despair’s furnace, slashing at shadows that laughed back."*
104
+
105
+ ### Limitations
106
+ - **NO MERCY FOR THE MEEK:** Too bleak for coward hearts—sunlight burns it.
107
+ - **TRUTH IS DEAD:** Sacrifices facts for **CREATIVE BLOODLUST**.
108
+ - **ENGLISH OR BUST:** One language, one abyss—cross it at your peril.
109
+
110
+ *Judge it by the screams it summons, not your mortal metrics.*
111
+
112
+
113
+ ## Sampler Settings (json file)
114
+ ```
115
+ {
116
+ "temp": 1,
117
+ "temperature_last": false,
118
+ "top_p": 0.95,
119
+ "top_k": 100,
120
+ "top_a": 0,
121
+ "tfs": 1,
122
+ "epsilon_cutoff": 0,
123
+ "eta_cutoff": 0,
124
+ "typical_p": 1,
125
+ "min_p": 0,
126
+ "rep_pen": 1.01,
127
+ "rep_pen_range": 2048,
128
+ "rep_pen_decay": 0,
129
+ "rep_pen_slope": 1,
130
+ "no_repeat_ngram_size": 0,
131
+ "penalty_alpha": 0,
132
+ "num_beams": 1,
133
+ "length_penalty": 1,
134
+ "min_length": 0,
135
+ "encoder_rep_pen": 1.02,
136
+ "freq_pen": 0,
137
+ "presence_pen": 0.02,
138
+ "skew": 0,
139
+ "do_sample": true,
140
+ "early_stopping": true,
141
+ "dynatemp": true,
142
+ "min_temp": 0.45,
143
+ "max_temp": 1.05,
144
+ "dynatemp_exponent": 0.85,
145
+ "smoothing_factor": 0.32,
146
+ "smoothing_curve": 1,
147
+ "dry_allowed_length": 3,
148
+ "dry_multiplier": 0.8,
149
+ "dry_base": 1.5,
150
+ "dry_sequence_breakers": "[\"\\n\", \":\", \"\\\"\", \"*\", \"`\", \";\", \"<\", \"(\", \"{\", \"[\", \"]\", \"}\", \")\", \">\", \"|\", \"+\", \"=\"]",
151
+ "dry_penalty_last_n": 4096,
152
+ "add_bos_token": true,
153
+ "ban_eos_token": false,
154
+ "skip_special_tokens": true,
155
+ "mirostat_mode": 0,
156
+ "mirostat_tau": 9.9,
157
+ "mirostat_eta": 0.05,
158
+ "guidance_scale": 1,
159
+ "negative_prompt": "",
160
+ "grammar_string": "",
161
+ "json_schema": {},
162
+ "banned_tokens": "",
163
+ "sampler_priority": [
164
+ "repetition_penalty",
165
+ "presence_penalty",
166
+ "frequency_penalty",
167
+ "dry",
168
+ "top_k",
169
+ "top_a",
170
+ "epsilon_cutoff",
171
+ "eta_cutoff",
172
+ "tfs",
173
+ "typical_p",
174
+ "top_p",
175
+ "min_p",
176
+ "temperature",
177
+ "dynamic_temperature",
178
+ "quadratic_sampling",
179
+ "mirostat",
180
+ "xtc",
181
+ "encoder_repetition_penalty",
182
+ "no_repeat_ngram"
183
+ ],
184
+ "samplers": [
185
+ "dry",
186
+ "top_k",
187
+ "tfs_z",
188
+ "typical_p",
189
+ "top_p",
190
+ "min_p",
191
+ "xtc",
192
+ "temperature"
193
+ ],
194
+ "samplers_priorities": [
195
+ "dry",
196
+ "penalties",
197
+ "no_repeat_ngram",
198
+ "temperature",
199
+ "top_nsigma",
200
+ "top_p_top_k",
201
+ "top_a",
202
+ "min_p",
203
+ "tfs",
204
+ "eta_cutoff",
205
+ "epsilon_cutoff",
206
+ "typical_p",
207
+ "quadratic",
208
+ "xtc"
209
+ ],
210
+ "ignore_eos_token": false,
211
+ "spaces_between_special_tokens": true,
212
+ "speculative_ngram": false,
213
+ "sampler_order": [
214
+ 6,
215
+ 0,
216
+ 1,
217
+ 3,
218
+ 4,
219
+ 2,
220
+ 5
221
+ ],
222
+ "logit_bias": [],
223
+ "xtc_threshold": 0.15,
224
+ "xtc_probability": 0,
225
+ "nsigma": 0,
226
+ "rep_pen_size": 0,
227
+ "genamt": 768,
228
+ "max_length": 8192
229
+ }
230
+ ```