Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Alcoft
/
Qwen2.5-1.5B-Instruct-GGUF
like
0
Text Generation
GGUF
13 languages
conversational
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
1
Deploy
Use this model
README.md exists but content is empty.
Downloads last month
4
GGUF
Model size
1.54B params
Architecture
qwen2
Chat template
Hardware compatibility
Log In
to view the estimation
2-bit
Q2_K
676 MB
3-bit
Q3_K_S
761 MB
Q3_K_M
824 MB
Q3_K_L
880 MB
4-bit
Q4_K_S
940 MB
Q4_K_M
986 MB
5-bit
Q5_K_S
1.1 GB
Q5_K_M
1.13 GB
6-bit
Q6_K
1.27 GB
8-bit
Q8_0
1.65 GB
View +1 variant
Inference Providers
NEW
Text Generation
This model isn't deployed by any Inference Provider.
๐
Ask for provider support
Model tree for
Alcoft/Qwen2.5-1.5B-Instruct-GGUF
Base model
Qwen/Qwen2.5-1.5B
Finetuned
Qwen/Qwen2.5-1.5B-Instruct
Quantized
(
115
)
this model
Collection including
Alcoft/Qwen2.5-1.5B-Instruct-GGUF
TAO71-AI Quants: Qwen2.5
Collection
4 items
โข
Updated
26 days ago