Hugging Face's logo

cgus
/
NemoMix-Unleashed-12B-exl2

Text Generation
Transformers
mistral
mergekit
Merge
conversational
4-bit precision
exl2
Model card Files Community
cgus commited on
Commit
8a13954
·
verified ·
1 Parent(s): b7a2ae6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +15 -2
README.md CHANGED
@@ -1,11 +1,24 @@
1
  ---
2
- base_model: []
3
  library_name: transformers
4
  tags:
5
  - mergekit
6
  - merge
 
7
  ---
8
-
 
 
 
 
 
 
 
 
 
 
 
 
 
9
  ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/6550b16f7490049d6237f200/zYBXSewLbIxWHZdB3oEHs.jpeg)
10
 
11
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/6550b16f7490049d6237f200/eRwPcd9Ox03hn_WRnsotj.png)
 
1
  ---
 
2
  library_name: transformers
3
  tags:
4
  - mergekit
5
  - merge
6
+ base_model: MarinaraSpaghetti/NemoMix-Unleashed-12B
7
  ---
8
+ # NemoMix-Unleashed-12B-exl2
9
+ Original model: [NemoMix-Unleashed-12B](https://huggingface.co/MarinaraSpaghetti/NemoMix-Unleashed-12B)
10
+ Creator: [MarinaraSpaghetti](https://huggingface.co/MarinaraSpaghetti)
11
+ ## Quants
12
+ [4bpw h6 (main)](https://huggingface.co/cgus/NemoMix-Unleashed-12B-exl2/tree/main)
13
+ [4.5bpw h6](https://huggingface.co/cgus/NemoMix-Unleashed-12B-exl2/tree/4.5bpw-h6)
14
+ [5bpw h6](https://huggingface.co/cgus/NemoMix-Unleashed-12B-exl2/tree/5bpw-h6)
15
+ [6bpw h6](https://huggingface.co/cgus/NemoMix-Unleashed-12B-exl2/tree/6bpw-h6)
16
+ [8bpw h8](https://huggingface.co/cgus/NemoMix-Unleashed-12B-exl2/tree/8bpw-h8)
17
+
18
+ ## Quantization notes
19
+ Made with Exllamav2 0.1.8 with the default dataset.
20
+
21
+ # Original model card
22
  ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/6550b16f7490049d6237f200/zYBXSewLbIxWHZdB3oEHs.jpeg)
23
 
24
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/6550b16f7490049d6237f200/eRwPcd9Ox03hn_WRnsotj.png)