Sharded GGUF version of bartowski/Qwen2.5-0.5B-Instruct-GGUF.

Downloads last month
351
GGUF
Model size
494M params
Architecture
qwen2
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.

Model tree for Felladrin/gguf-sharded-Q4_K_S-Qwen2.5-0.5B-Instruct

Base model

Qwen/Qwen2.5-0.5B
Quantized
(2)
this model