Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
kaitchup
/
Meta-Llama-3.1-8B-Instruct-autoround-gptq-4bit-sym
like
1
Follow
The Kaitchup
16
Text Generation
Transformers
Safetensors
English
llama
auto-gptq
AutoRound
conversational
text-generation-inference
Inference Endpoints
4-bit precision
gptq
License:
cc-by-4.0
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
Meta-Llama-3.1-8B-Instruct-autoround-gptq-4bit-sym
/
model-00001-of-00002.safetensors
Commit History
Upload LlamaForCausalLM
96ecfd7
verified
bnjmnmarie
commited on
Aug 8