Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
RedHatAI
/
Meta-Llama-3.1-8B-quantized.w8a16
like
1
Follow
Red Hat AI
1.08k
Text Generation
Transformers
Safetensors
8 languages
llama
int8
vllm
text-generation-inference
compressed-tensors
arxiv:
2210.17323
License:
llama3.1
Model card
Files
Files and versions
xet
Community
Train
Deploy
Use this model
main
Meta-Llama-3.1-8B-quantized.w8a16
Commit History
Updated compression_config to quantization_config
b65e953
verified
mgoin
commited on
Oct 9, 2024
Update README.md
a8f35c6
verified
alexmarques
commited on
Aug 13, 2024
Update README.md
302fdc8
verified
alexmarques
commited on
Aug 13, 2024
Update README.md
ddadfa9
verified
alexmarques
commited on
Jul 31, 2024
Update README.md
b5146ed
verified
alexmarques
commited on
Jul 31, 2024
Create README.md
257f5ca
verified
alexmarques
commited on
Jul 31, 2024
Upload folder using huggingface_hub
2f1d7c5
verified
alexmarques
commited on
Jul 31, 2024
initial commit
6bcdb67
verified
alexmarques
commited on
Jul 31, 2024