JunHowie
/

Qwen2-7B-Instruct-GPTQ-Int8

Text Generation

text-generation-inference

8-bit precision

Model card Files Files and versions

Qwen2-7B-Instruct-GPTQ-Int8

8.88 GB

1 contributor

History: 3 commits

JunHowie's picture

Upload README.md

fcc8f70 verified about 1 month ago

.gitattributes

1.57 kB

Upload folder using huggingface_hub about 1 month ago
README.md

7.23 kB

Upload README.md about 1 month ago
added_tokens.json

80 Bytes

Upload folder using huggingface_hub about 1 month ago
chat_template.jinja

328 Bytes

Upload folder using huggingface_hub about 1 month ago
config.json

1.88 kB

Upload folder using huggingface_hub about 1 month ago
generation_config.json

243 Bytes

Upload folder using huggingface_hub about 1 month ago
merges.txt

1.67 MB

Upload folder using huggingface_hub about 1 month ago
model-00001-of-00003.safetensors

3.98 GB
xet

Upload folder using huggingface_hub about 1 month ago
model-00002-of-00003.safetensors

3.79 GB
xet

Upload folder using huggingface_hub about 1 month ago
model-00003-of-00003.safetensors

1.09 GB
xet

Upload folder using huggingface_hub about 1 month ago
model.safetensors.index.json

75.4 kB

Upload folder using huggingface_hub about 1 month ago
quantize_config.json

485 Bytes

Upload folder using huggingface_hub about 1 month ago
special_tokens_map.json

245 Bytes

Upload folder using huggingface_hub about 1 month ago
tokenizer.json

11.4 MB
xet

Upload folder using huggingface_hub about 1 month ago
tokenizer_config.json

993 Bytes

Upload folder using huggingface_hub about 1 month ago
vocab.json

2.78 MB

Upload folder using huggingface_hub about 1 month ago