Update README.md
Browse files
README.md
CHANGED
@@ -10,7 +10,7 @@ tags:
|
|
10 |
|
11 |
# chronos-13b-v2
|
12 |
|
13 |
-
This is the 4bit GPTQ of **chronos-13b-v2** based on the **
|
14 |
|
15 |
This model is primarily focused on chat, roleplay, storywriting, with good reasoning and logic.
|
16 |
|
@@ -24,6 +24,10 @@ Your instruction or question here.
|
|
24 |
```
|
25 |
Not using the format will make the model perform significantly worse than intended.
|
26 |
|
|
|
|
|
|
|
|
|
27 |
## Other Versions
|
28 |
[Original FP16 Model](https://huggingface.co/elinas/chronos-13b-v2)
|
29 |
|
|
|
10 |
|
11 |
# chronos-13b-v2
|
12 |
|
13 |
+
This is the 4bit GPTQ of **chronos-13b-v2** based on the **Llama v2 Base** model. It works with Exllama and AutoGPTQ.
|
14 |
|
15 |
This model is primarily focused on chat, roleplay, storywriting, with good reasoning and logic.
|
16 |
|
|
|
24 |
```
|
25 |
Not using the format will make the model perform significantly worse than intended.
|
26 |
|
27 |
+
# Quantize Config
|
28 |
+
Rename `quantize_config_Xg.json` where X is the groupsize to `quantize_config.json` for the version you pick.
|
29 |
+
|
30 |
+
|
31 |
## Other Versions
|
32 |
[Original FP16 Model](https://huggingface.co/elinas/chronos-13b-v2)
|
33 |
|