Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Alcoft
/
Phi-3.5-mini-instruct-GGUF
like
0
Text Generation
GGUF
multilingual
conversational
License:
mit
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
README.md exists but content is empty.
Downloads last month
3
GGUF
Model size
3.82B params
Architecture
phi3
Chat template
Hardware compatibility
Log In
to view the estimation
2-bit
Q2_K
1.42 GB
3-bit
Q3_K_S
1.68 GB
Q3_K_M
1.96 GB
Q3_K_L
2.09 GB
4-bit
Q4_K_S
2.19 GB
Q4_K_M
2.39 GB
5-bit
Q5_K_S
2.64 GB
Q5_K_M
2.82 GB
6-bit
Q6_K
3.14 GB
8-bit
Q8_0
4.06 GB
16-bit
BF16
7.64 GB
F16
7.64 GB
Inference Providers
NEW
Text Generation
This model isn't deployed by any Inference Provider.
๐
Ask for provider support
Model tree for
Alcoft/Phi-3.5-mini-instruct-GGUF
Base model
microsoft/Phi-3.5-mini-instruct
Quantized
(
153
)
this model
Collection including
Alcoft/Phi-3.5-mini-instruct-GGUF
TAO71-AI Quants: Phi-3.5
Collection
1 item
โข
Updated
26 days ago