Update README.md
Browse files
README.md
CHANGED
@@ -47,18 +47,20 @@ Mistralai's newest "Mistral-Small-3.1-24B-Instruct-2503" model with "Neo Imatrix
|
|
47 |
|
48 |
Like almost all of Mistralai's models this model is mostly uncensored.
|
49 |
|
|
|
|
|
50 |
NOTE: This model is text generation only, it does not contain "vision" components.
|
51 |
|
52 |
5 examples provided below with prompts at IQ4XS.
|
53 |
|
54 |
Context: 128k.
|
55 |
|
56 |
-
"MAXED"
|
57 |
|
58 |
This means the embed and output tensor are set at "BF16" (full precision) for all quants.
|
59 |
This enhances quality, depth and general performance at the cost of a slightly larger quant.
|
60 |
|
61 |
-
"NEO IMATRIX"
|
62 |
|
63 |
A strong, in house built, imatrix dataset built by David_AU which results in better overall function,
|
64 |
instruction following, output quality and stronger connections to ideas, concepts and the world in general.
|
@@ -80,11 +82,13 @@ F16
|
|
80 |
</pre>
|
81 |
</small>
|
82 |
|
83 |
-
Recommend quants IQ3s / IQ4XS / IQ4NL / Q4s for best results for creative.
|
|
|
84 |
|
85 |
IQ4XS/IQ4NL quants will produce different output from other "Q" and "IQ" quants.
|
|
|
86 |
|
87 |
-
The
|
88 |
|
89 |
Recommend q5s/q6/q8 for general usage.
|
90 |
|
@@ -136,7 +140,7 @@ You are a deep thinking AI, you may use extremely long chains of thought to deep
|
|
136 |
|
137 |
Option #3 - Creative Plus
|
138 |
|
139 |
-
This will enhance the creative power of the model.
|
140 |
|
141 |
Copy and paste exactly as shown, including line breaks.
|
142 |
|
|
|
47 |
|
48 |
Like almost all of Mistralai's models this model is mostly uncensored.
|
49 |
|
50 |
+
I have included 3 different system prompts to help this model come alive.
|
51 |
+
|
52 |
NOTE: This model is text generation only, it does not contain "vision" components.
|
53 |
|
54 |
5 examples provided below with prompts at IQ4XS.
|
55 |
|
56 |
Context: 128k.
|
57 |
|
58 |
+
<B>"MAXED"</B>
|
59 |
|
60 |
This means the embed and output tensor are set at "BF16" (full precision) for all quants.
|
61 |
This enhances quality, depth and general performance at the cost of a slightly larger quant.
|
62 |
|
63 |
+
<B>"NEO IMATRIX"</B>
|
64 |
|
65 |
A strong, in house built, imatrix dataset built by David_AU which results in better overall function,
|
66 |
instruction following, output quality and stronger connections to ideas, concepts and the world in general.
|
|
|
82 |
</pre>
|
83 |
</small>
|
84 |
|
85 |
+
Recommend quants IQ3s / IQ4XS / IQ4NL / Q4s for best results for creative use cases.
|
86 |
+
I also suggest using "System Prompt #3" below to really power up this model for creative uses.
|
87 |
|
88 |
IQ4XS/IQ4NL quants will produce different output from other "Q" and "IQ" quants.
|
89 |
+
I like these best for creative.
|
90 |
|
91 |
+
The will be strongest at IQ4s (1st choice) / Q4s (2nd choice) and lower.
|
92 |
|
93 |
Recommend q5s/q6/q8 for general usage.
|
94 |
|
|
|
140 |
|
141 |
Option #3 - Creative Plus
|
142 |
|
143 |
+
This will enhance the creative power of the model. The model will literally come alive with this one - it is like night and day.
|
144 |
|
145 |
Copy and paste exactly as shown, including line breaks.
|
146 |
|