chplushsieh
/

Meta-Llama-3-8B-Instruct-abliterated-v3-GPTQ-4bit

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

chplushsieh commited on Jun 5

Commit

0491f65

•

1 Parent(s): 987fe6c

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -5,6 +5,6 @@ library_name: transformers
 # Description
-This is a 4-bit GPTQ quantized model for [failspy/Meta-Llama-3-8B-Instruct-abliterated-v3](https://huggingface.co/failspy/Meta-Llama-3-8B-Instruct-abliterated-v3)
 It is quantized with `wikitext2` dataset.
 Its file size is 5.73 GB, and can fit into a 8GB VRAM GPU.

 # Description
+This is a 4-bit GPTQ quantized model of [failspy/Meta-Llama-3-8B-Instruct-abliterated-v3](https://huggingface.co/failspy/Meta-Llama-3-8B-Instruct-abliterated-v3)
 It is quantized with `wikitext2` dataset.
 Its file size is 5.73 GB, and can fit into a 8GB VRAM GPU.