Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
QuantFactory
/
Meta-Llama-3.1-8B-Claude-GGUF
like
1
Follow
Quant Factory
464
GGUF
conversational
Model card
Files
Files and versions
Community
1
Deploy
Use this model
No model card
Downloads last month
101
GGUF
Model size
8.03B params
Architecture
llama
Chat template
Hardware compatibility
Log In
to view the estimation
2-bit
Q2_K
3.18 GB
3-bit
Q3_K_S
3.66 GB
Q3_K_M
4.02 GB
Q3_K_L
4.32 GB
4-bit
Q4_K_S
4.69 GB
Q4_0
4.66 GB
Q4_1
5.13 GB
Q4_K_M
4.92 GB
5-bit
Q5_K_S
5.6 GB
Q5_0
5.6 GB
Q5_1
6.07 GB
Q5_K_M
5.73 GB
6-bit
Q6_K
6.6 GB
8-bit
Q8_0
8.54 GB
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
๐
Ask for provider support
HF Inference deployability: The model has no library tag.
Collection including
QuantFactory/Meta-Llama-3.1-8B-Claude-GGUF
Llama-3.1
Collection
4 items
โข
Updated
Oct 3, 2024
โข
6