TheBloke
/

guanaco-7B-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

guanaco-7B-GPTQ

4.03 GB

1 contributor

History: 13 commits

TheBloke's picture

Upload README.md

c21b752 about 2 years ago

.gitattributes

1.48 kB

initial commit over 2 years ago
README.md

15.1 kB

Upload README.md about 2 years ago
config.json

851 Bytes

Update for Transformers GPTQ support about 2 years ago
generation_config.json

132 Bytes

Upload new GPTQs with varied parameters about 2 years ago
model.safetensors

4.02 GB
xet

Update for Transformers GPTQ support about 2 years ago
quantize_config.json

186 Bytes

Update for Transformers GPTQ support about 2 years ago
special_tokens_map.json

411 Bytes

Upload new GPTQs with varied parameters about 2 years ago
tokenizer.json

1.84 MB

Upload new GPTQs with varied parameters about 2 years ago
tokenizer.model

500 kB
xet

Upload new GPTQs with varied parameters about 2 years ago
tokenizer_config.json

700 Bytes

Upload new GPTQs with varied parameters about 2 years ago