DavidAU commited on
Commit
14ae801
·
verified ·
1 Parent(s): 385549a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -5
README.md CHANGED
@@ -47,18 +47,20 @@ Mistralai's newest "Mistral-Small-3.1-24B-Instruct-2503" model with "Neo Imatrix
47
 
48
  Like almost all of Mistralai's models this model is mostly uncensored.
49
 
 
 
50
  NOTE: This model is text generation only, it does not contain "vision" components.
51
 
52
  5 examples provided below with prompts at IQ4XS.
53
 
54
  Context: 128k.
55
 
56
- "MAXED"
57
 
58
  This means the embed and output tensor are set at "BF16" (full precision) for all quants.
59
  This enhances quality, depth and general performance at the cost of a slightly larger quant.
60
 
61
- "NEO IMATRIX"
62
 
63
  A strong, in house built, imatrix dataset built by David_AU which results in better overall function,
64
  instruction following, output quality and stronger connections to ideas, concepts and the world in general.
@@ -80,11 +82,13 @@ F16
80
  </pre>
81
  </small>
82
 
83
- Recommend quants IQ3s / IQ4XS / IQ4NL / Q4s for best results for creative.
 
84
 
85
  IQ4XS/IQ4NL quants will produce different output from other "Q" and "IQ" quants.
 
86
 
87
- The "horror tint" will be strongest at IQ4s (1st choice) / Q4s (2nd choice) and lower.
88
 
89
  Recommend q5s/q6/q8 for general usage.
90
 
@@ -136,7 +140,7 @@ You are a deep thinking AI, you may use extremely long chains of thought to deep
136
 
137
  Option #3 - Creative Plus
138
 
139
- This will enhance the creative power of the model.
140
 
141
  Copy and paste exactly as shown, including line breaks.
142
 
 
47
 
48
  Like almost all of Mistralai's models this model is mostly uncensored.
49
 
50
+ I have included 3 different system prompts to help this model come alive.
51
+
52
  NOTE: This model is text generation only, it does not contain "vision" components.
53
 
54
  5 examples provided below with prompts at IQ4XS.
55
 
56
  Context: 128k.
57
 
58
+ <B>"MAXED"</B>
59
 
60
  This means the embed and output tensor are set at "BF16" (full precision) for all quants.
61
  This enhances quality, depth and general performance at the cost of a slightly larger quant.
62
 
63
+ <B>"NEO IMATRIX"</B>
64
 
65
  A strong, in house built, imatrix dataset built by David_AU which results in better overall function,
66
  instruction following, output quality and stronger connections to ideas, concepts and the world in general.
 
82
  </pre>
83
  </small>
84
 
85
+ Recommend quants IQ3s / IQ4XS / IQ4NL / Q4s for best results for creative use cases.
86
+ I also suggest using "System Prompt #3" below to really power up this model for creative uses.
87
 
88
  IQ4XS/IQ4NL quants will produce different output from other "Q" and "IQ" quants.
89
+ I like these best for creative.
90
 
91
+ The will be strongest at IQ4s (1st choice) / Q4s (2nd choice) and lower.
92
 
93
  Recommend q5s/q6/q8 for general usage.
94
 
 
140
 
141
  Option #3 - Creative Plus
142
 
143
+ This will enhance the creative power of the model. The model will literally come alive with this one - it is like night and day.
144
 
145
  Copy and paste exactly as shown, including line breaks.
146