Update README.md
Browse files
README.md
CHANGED
@@ -52,6 +52,8 @@ IQ4XS/IQ4NL quants will produce different output from other "Q" and "IQ" quants.
|
|
52 |
|
53 |
Recommend q5s/q6/q8 for general usage.
|
54 |
|
|
|
|
|
55 |
Q8 is a maxed quant only, as imatrix has no effect on this quant.
|
56 |
|
57 |
Note that IQ1s performance is low, whereas IQ2s are passable.
|
|
|
52 |
|
53 |
Recommend q5s/q6/q8 for general usage.
|
54 |
|
55 |
+
Quants Q4_0/Q5_0 for portable, phone and other devices.
|
56 |
+
|
57 |
Q8 is a maxed quant only, as imatrix has no effect on this quant.
|
58 |
|
59 |
Note that IQ1s performance is low, whereas IQ2s are passable.
|