DavidAU commited on
Commit
a3c08db
·
verified ·
1 Parent(s): d2d74b4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +29 -2
README.md CHANGED
@@ -189,11 +189,38 @@ Model behaviour may change with other parameter(s) and/or sampler(s) activated -
189
 
190
  ---
191
 
192
- <B>System Role / System Prompt - Augment The Model's Power:</b>
 
 
193
 
194
  ---
195
 
196
- If you set / have a system prompt this will affect both "generation" and "thinking/reasoning".
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
197
 
198
  SIMPLE:
199
 
 
189
 
190
  ---
191
 
192
+ <B>System Role / System Prompts - Reasoning On/Off/Variable and Augment The Model's Power:</b>
193
+
194
+ <small> ( <font color="red">Critical Setting for model operation </font> ) </small>
195
 
196
  ---
197
 
198
+ System Role / System Prompt / System Message (called "System Prompt" in this section)
199
+ is "root access" to the model and controls internal workings - both instruction following and output generation and in the
200
+ case of this model reasoning control and on/off for reasoning too.
201
+
202
+ In this section I will show you basic, advanced, and combined "code" to control the model's reasoning, instruction following and output generation.
203
+
204
+ If you do not set a "system prompt", reasoning/thinking will be OFF by default, and the model will operate like a normal LLM.
205
+
206
+ HOW TO SET:
207
+
208
+ Depending on your AI "app" you may have to copy/paste on of the "codes" below to enable reasoning/thinking in the
209
+ "System Prompt" or "System Role" window.
210
+
211
+ In Lmstudio set/activate "Power User" or "Developer" mode to access, copy/paste to System Prompt Box.
212
+
213
+ In SillyTavern go to the "template page" ("A") , activate "system prompt" and enter the text in the prompt box.
214
+
215
+ In Ollama see [ https://github.com/ollama/ollama/blob/main/README.md ] ; and setting the "system message".
216
+
217
+ In Koboldcpp, load the model, start it, go to settings -> select "Llama 3 Chat"/"Command-R" and enter the text in the "sys prompt" box.
218
+
219
+ SYSTEM PROMPTS AVAILABLE:
220
+
221
+ When you copy/paste PRESERVE formatting, including line breaks.
222
+
223
+ If you want to edit/adjust these only do so in NOTEPAD OR the LLM App directly.
224
 
225
  SIMPLE:
226