Text Generation
Transformers
Safetensors
English
llama
creative
creative writing
fiction writing
plot generation
sub-plot generation
story generation
scene continue
storytelling
fiction story
science fiction
llama 3.1
llama-3
llama3
llama-3.1
romance
all genres
story
writing
vivid prosing
vivid writing
fiction
roleplaying
bfloat16
swearing
role play
sillytavern
backyard
horror
context 128k
mergekit
Merge
Not-For-All-Audiences
conversational
text-generation-inference
Update README.md
Browse files
README.md
CHANGED
@@ -189,11 +189,38 @@ Model behaviour may change with other parameter(s) and/or sampler(s) activated -
|
|
189 |
|
190 |
---
|
191 |
|
192 |
-
<B>System Role / System
|
|
|
|
|
193 |
|
194 |
---
|
195 |
|
196 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
197 |
|
198 |
SIMPLE:
|
199 |
|
|
|
189 |
|
190 |
---
|
191 |
|
192 |
+
<B>System Role / System Prompts - Reasoning On/Off/Variable and Augment The Model's Power:</b>
|
193 |
+
|
194 |
+
<small> ( <font color="red">Critical Setting for model operation </font> ) </small>
|
195 |
|
196 |
---
|
197 |
|
198 |
+
System Role / System Prompt / System Message (called "System Prompt" in this section)
|
199 |
+
is "root access" to the model and controls internal workings - both instruction following and output generation and in the
|
200 |
+
case of this model reasoning control and on/off for reasoning too.
|
201 |
+
|
202 |
+
In this section I will show you basic, advanced, and combined "code" to control the model's reasoning, instruction following and output generation.
|
203 |
+
|
204 |
+
If you do not set a "system prompt", reasoning/thinking will be OFF by default, and the model will operate like a normal LLM.
|
205 |
+
|
206 |
+
HOW TO SET:
|
207 |
+
|
208 |
+
Depending on your AI "app" you may have to copy/paste on of the "codes" below to enable reasoning/thinking in the
|
209 |
+
"System Prompt" or "System Role" window.
|
210 |
+
|
211 |
+
In Lmstudio set/activate "Power User" or "Developer" mode to access, copy/paste to System Prompt Box.
|
212 |
+
|
213 |
+
In SillyTavern go to the "template page" ("A") , activate "system prompt" and enter the text in the prompt box.
|
214 |
+
|
215 |
+
In Ollama see [ https://github.com/ollama/ollama/blob/main/README.md ] ; and setting the "system message".
|
216 |
+
|
217 |
+
In Koboldcpp, load the model, start it, go to settings -> select "Llama 3 Chat"/"Command-R" and enter the text in the "sys prompt" box.
|
218 |
+
|
219 |
+
SYSTEM PROMPTS AVAILABLE:
|
220 |
+
|
221 |
+
When you copy/paste PRESERVE formatting, including line breaks.
|
222 |
+
|
223 |
+
If you want to edit/adjust these only do so in NOTEPAD OR the LLM App directly.
|
224 |
|
225 |
SIMPLE:
|
226 |
|