Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
ISTA-DASLab
/
Llama-3.1-8B-Instruct-MR-GPTQ-mxfp
like
0
Follow
IST Austria Distributed Algorithms and Systems Lab
113
Image-Text-to-Text
Transformers
Safetensors
llama
text-generation
int4
vllm
llmcompressor
conversational
text-generation-inference
8-bit precision
fp_quant
License:
llama3.1
Model card
Files
Files and versions
xet
Community
1
Train
Deploy
Use this model
main
Llama-3.1-8B-Instruct-MR-GPTQ-mxfp
5.84 GB
2 contributors
History:
4 commits
SpiridonSunRotator
Round to 2 decimal digits
269ad6e
verified
19 days ago
.gitattributes
Safe
1.57 kB
Initial upload of quantized model
20 days ago
README.md
2.5 kB
Round to 2 decimal digits
19 days ago
chat_template.jinja
Safe
4.61 kB
Initial upload of quantized model
20 days ago
config.json
Safe
1.19 kB
Initial upload of quantized model
20 days ago
generation_config.json
Safe
189 Bytes
Initial upload of quantized model
20 days ago
model-1-of-2.safetensors
4.77 GB
xet
Initial upload of quantized model
20 days ago
model-2-of-2.safetensors
1.05 GB
xet
Initial upload of quantized model
20 days ago
model.safetensors.index.json
Safe
111 kB
Initial upload of quantized model
20 days ago
special_tokens_map.json
Safe
296 Bytes
Initial upload of quantized model
20 days ago
tokenizer.json
17.2 MB
xet
Initial upload of quantized model
20 days ago
tokenizer_config.json
Safe
50.5 kB
Initial upload of quantized model
20 days ago
