Update README.md
Browse files
README.md
CHANGED
|
@@ -14,15 +14,7 @@ license: apache-2.0
|
|
| 14 |
|
| 15 |
<h2>Gemma-3-1b-it-MAX-NEO-Imatrix-GGUF</h2>
|
| 16 |
|
| 17 |
-
Google's newest Gemma-3 model with Neo Imatrix and Maxed out
|
| 18 |
-
|
| 19 |
-
Recommend quants IQ3s / IQ4XS / Q4s for best results for creative.
|
| 20 |
-
|
| 21 |
-
Recommend q5s/q6/q8 for general usage.
|
| 22 |
-
|
| 23 |
-
Q8 is a maxed quant only, as imatrix has no effect on this quant.
|
| 24 |
-
|
| 25 |
-
Note that IQ1 performance is low, whereas IQ2s are passable.
|
| 26 |
|
| 27 |
"MAXED"
|
| 28 |
|
|
@@ -51,6 +43,14 @@ F16
|
|
| 51 |
</pre>
|
| 52 |
</small>
|
| 53 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 54 |
More information on quants is in the document below "Highest Quality Settings / Optimal Operation Guide / Parameters and Samplers".
|
| 55 |
|
| 56 |
<b>Optional : System Prompt</b>
|
|
|
|
| 14 |
|
| 15 |
<h2>Gemma-3-1b-it-MAX-NEO-Imatrix-GGUF</h2>
|
| 16 |
|
| 17 |
+
Google's newest Gemma-3 model with "Neo Imatrix" and "Maxed out" quantization to improve overall performance.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 18 |
|
| 19 |
"MAXED"
|
| 20 |
|
|
|
|
| 43 |
</pre>
|
| 44 |
</small>
|
| 45 |
|
| 46 |
+
Recommend quants IQ3s / IQ4XS / Q4s for best results for creative.
|
| 47 |
+
|
| 48 |
+
Recommend q5s/q6/q8 for general usage.
|
| 49 |
+
|
| 50 |
+
Q8 is a maxed quant only, as imatrix has no effect on this quant.
|
| 51 |
+
|
| 52 |
+
Note that IQ1 performance is low, whereas IQ2s are passable.
|
| 53 |
+
|
| 54 |
More information on quants is in the document below "Highest Quality Settings / Optimal Operation Guide / Parameters and Samplers".
|
| 55 |
|
| 56 |
<b>Optional : System Prompt</b>
|