gghfez
/

WizardLM-2-22B-RP-exl2

Text Generation

8-bit precision

Model card Files Files and versions Community

gghfez commited on Dec 31, 2024

Commit

232ba51

·

verified ·

1 Parent(s): 11d6fc2

Update README.md

Files changed (1) hide show

README.md +4 -1

README.md CHANGED Viewed

@@ -16,7 +16,10 @@ tags:
 EXL2 Quants of [gghfez/WizardLM-2-22B-RP](https://huggingface.co/gghfez/WizardLM-2-22B-RP)
 |BPW|Size|
-|[8_0](https://huggingface.co/gghfez/WizardLM-2-22B-RP-exl2)|18.2 GiB|
 Original Model Card:

 EXL2 Quants of [gghfez/WizardLM-2-22B-RP](https://huggingface.co/gghfez/WizardLM-2-22B-RP)
 |BPW|Size|
+|---|---|
+|[8_0](https://huggingface.co/gghfez/WizardLM-2-22B-RP-exl2/tree/8_0)|18.2 GiB|
+|[6_0](https://huggingface.co/gghfez/WizardLM-2-22B-RP-exl2/tree/6_0)|14.0 GiB|
+|[5_0](https://huggingface.co/gghfez/WizardLM-2-22B-RP-exl2/tree/5_0)|12.0 GiB|
 Original Model Card: