davidxmle
/

Llama-3-8B-Instruct-GPTQ-4-Bit-Debug

Text Generation

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Llama-3-8B-Instruct-GPTQ-4-Bit-Debug

1 contributor

History: 3 commits

davidxmle's picture

Rename model.safetensors to gptq_model-4bit-128g.safetensors

8de7067 verified 7 months ago

.gitattributes

1.52 kB

Duplicate from astronomer/Llama-3-8B-Instruct-GPTQ-4-Bit 7 months ago
LICENSE.txt

7.8 kB

Duplicate from astronomer/Llama-3-8B-Instruct-GPTQ-4-Bit 7 months ago
README.md

4.63 kB

Update README.md 7 months ago
USE_POLICY.md

4.7 kB

Duplicate from astronomer/Llama-3-8B-Instruct-GPTQ-4-Bit 7 months ago
config.json

1.02 kB

Duplicate from astronomer/Llama-3-8B-Instruct-GPTQ-4-Bit 7 months ago
generation_config.json

136 Bytes

Duplicate from astronomer/Llama-3-8B-Instruct-GPTQ-4-Bit 7 months ago
gptq_model-4bit-128g.safetensors

5.74 GB
LFS

Rename model.safetensors to gptq_model-4bit-128g.safetensors 7 months ago
quantize_config.json

264 Bytes

Duplicate from astronomer/Llama-3-8B-Instruct-GPTQ-4-Bit 7 months ago
special_tokens_map.json

301 Bytes

Duplicate from astronomer/Llama-3-8B-Instruct-GPTQ-4-Bit 7 months ago
tokenizer.json

9.08 MB

Duplicate from astronomer/Llama-3-8B-Instruct-GPTQ-4-Bit 7 months ago
tokenizer_config.json

51 kB

Duplicate from astronomer/Llama-3-8B-Instruct-GPTQ-4-Bit 7 months ago