Hugging Face's logo

Limour
/
CausalLM-14B-GGUF

GGUF
Chinese
Model card Files Community
1
Limour commited on
Commit
e7ca1e2
·
verified ·
1 Parent(s): 00d9f00

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -2
README.md CHANGED
@@ -6,8 +6,11 @@ language:
6
  - zh
7
  ---
8
  # Quantize
9
- https://colab.research.google.com/drive/1JT3XFjD7CTRB97pu3QpeGuzWA1yYEAM7?usp=sharing
 
10
  # Perplexity
11
- PPL = 13.3798 +/- 0.13641
 
 
12
 
13
  https://www.kaggle.com/code/reginliu/perplexity
 
6
  - zh
7
  ---
8
  # Quantize
9
+ + https://www.kaggle.com/code/reginliu/causallm2gguf-imatrix
10
+ + https://colab.research.google.com/drive/1JT3XFjD7CTRB97pu3QpeGuzWA1yYEAM7?usp=sharing
11
  # Perplexity
12
+ + causallm_14b.IQ4_XS.gguf: PPL = 13.4127 +/- 0.13762
13
+ + causallm_14b.IQ3_XS.gguf: PPL = 13.3798 +/- 0.13641
14
+ + causallm_14b.IQ2_XXS.gguf: PPL = 15.0160 +/- 0.15004
15
 
16
  https://www.kaggle.com/code/reginliu/perplexity