Hugging Face's logo

altomek
/
Llama-3.2-3B-Instruct-GGUF

Text Generation
Transformers
GGUF
PyTorch
facebook
meta
llama
llama-3
imatrix
conversational
Model card Files Community

Llama-3.2-3B-Instruct

Selected GGUF quants of https://huggingface.co/alpindale/Llama-3.2-3B-Instruct

Downloads last month
28
GGUF
Model size
3.21B params
Architecture
llama

4-bit

Inference Providers NEW
Text Generation
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API has been turned off for this model.

Model tree for altomek/Llama-3.2-3B-Instruct-GGUF

Base model

alpindale/Llama-3.2-3B-Instruct
Quantized
(5)
this model

Collection including altomek/Llama-3.2-3B-Instruct-GGUF