Commit
·
b0f5328
1
Parent(s):
e13f23a
Update README.md
Browse files
README.md
CHANGED
|
@@ -23,6 +23,20 @@ It primarily uses the Capybara and No Robots datasets (thus the name). The goal
|
|
| 23 |
|
| 24 |
[Exl2 Quants](https://huggingface.co/royallab/Norobara-ZLoss-8x7B-exl2)
|
| 25 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 26 |
## Usage:
|
| 27 |
The intended prompt format is a modified multi-turn Alpaca instruction format:
|
| 28 |
```
|
|
|
|
| 23 |
|
| 24 |
[Exl2 Quants](https://huggingface.co/royallab/Norobara-ZLoss-8x7B-exl2)
|
| 25 |
|
| 26 |
+
Quants courtesy of TheBloke:
|
| 27 |
+
- [GPTQ](https://huggingface.co/TheBloke/Norobara-ZLoss-8x7B-GPTQ)
|
| 28 |
+
- [GGUF](https://huggingface.co/TheBloke/Norobara-ZLoss-8x7B-GGUF)
|
| 29 |
+
- [AWQ](https://huggingface.co/TheBloke/Norobara-ZLoss-8x7B-AWQ)
|
| 30 |
+
-
|
| 31 |
+
Additional Exl2 Quants courtesy of LoneStriker:
|
| 32 |
+
- [2.4bpw](https://huggingface.co/LoneStriker/Norobara-ZLoss-8x7B-2.4bpw-h6-exl2)
|
| 33 |
+
- [3.0bpw](https://huggingface.co/LoneStriker/Norobara-ZLoss-8x7B-3.0bpw-h6-exl2)
|
| 34 |
+
- [3.5bpw](https://huggingface.co/LoneStriker/Norobara-ZLoss-8x7B-3.5bpw-h6-exl2)
|
| 35 |
+
- [3.75bpw](https://huggingface.co/LoneStriker/Norobara-ZLoss-8x7B-3.75bpw-h6-exl2)
|
| 36 |
+
- [4.0bpw](https://huggingface.co/LoneStriker/Norobara-ZLoss-8x7B-4.0bpw-h6-exl2)
|
| 37 |
+
- [5.0bpw](https://huggingface.co/LoneStriker/Norobara-ZLoss-8x7B-5.0bpw-h6-exl2)
|
| 38 |
+
- [6.0bpw](https://huggingface.co/LoneStriker/Norobara-ZLoss-8x7B-6.0bpw-h6-exl2)
|
| 39 |
+
|
| 40 |
## Usage:
|
| 41 |
The intended prompt format is a modified multi-turn Alpaca instruction format:
|
| 42 |
```
|