LLMJapan
/

OlympicCoder-7B_exl2_5.0bpw

Text Generation

text-generation-inference

Model card Files Files and versions Community

LLMJapan commited on Mar 15

Commit

e9c29bd

·

verified ·

1 Parent(s): 71ffbcb

Update README.md

Quantization updated

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -24,8 +24,8 @@ python convert.py \
     -i {path}/OlympicCoder-7B \
     -o {path}/OlympicCoder-7B/workingdir/ \
     -cf {path}/OlympicCoder-7B_5.0bpw/ \
-    -b 8.0 \
-    -hb 8
 ```
 # Model Card for OlympicCoder-7B

     -i {path}/OlympicCoder-7B \
     -o {path}/OlympicCoder-7B/workingdir/ \
     -cf {path}/OlympicCoder-7B_5.0bpw/ \
+    -b 5.0 \
+    -hb 6
 ```
 # Model Card for OlympicCoder-7B