PrunaAI
/

mattshumer-Llama-3-8B-16K-AWQ-4bit-smashed

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

mattshumer-Llama-3-8B-16K-AWQ-4bit-smashed

Ctrl+K

Ctrl+K

1 contributor

History: 3 commits

sharpenb's picture

cc9201c651891ff6bf086c10046b3be04726ffd64a507ff3d598e04ccd892219

b59aa0d verified about 1 year ago

.gitattributes

1.52 kB

initial commit about 1 year ago
README.md

5.29 kB

cc9201c651891ff6bf086c10046b3be04726ffd64a507ff3d598e04ccd892219 about 1 year ago
config.json

869 Bytes

cc9201c651891ff6bf086c10046b3be04726ffd64a507ff3d598e04ccd892219 about 1 year ago
generation_config.json

142 Bytes

cc9201c651891ff6bf086c10046b3be04726ffd64a507ff3d598e04ccd892219 about 1 year ago
model-00001-of-00002.safetensors

4.68 GB
xet

3e37323e9c02dd4aa02525ae5aaf47a00e30d8cf8926a0153f0cc97252f83602 about 1 year ago
model-00002-of-00002.safetensors

1.05 GB
xet

cc9201c651891ff6bf086c10046b3be04726ffd64a507ff3d598e04ccd892219 about 1 year ago
model.safetensors.index.json

63.5 kB

cc9201c651891ff6bf086c10046b3be04726ffd64a507ff3d598e04ccd892219 about 1 year ago
plots.png

452 kB

cc9201c651891ff6bf086c10046b3be04726ffd64a507ff3d598e04ccd892219 about 1 year ago
results.json

1.49 kB

cc9201c651891ff6bf086c10046b3be04726ffd64a507ff3d598e04ccd892219 about 1 year ago
smash_config.json

1.01 kB

cc9201c651891ff6bf086c10046b3be04726ffd64a507ff3d598e04ccd892219 about 1 year ago