Hugging Face's logo

afrideva
/
malaysian-tinyllama-1.1b-16384-instructions-GGUF

Text Generation
GGUF
ggml
quantized
q2_k
q3_k_m
q4_k_m
q5_k_m
q6_k
q8_0
Model card Files Community

mesolitica/malaysian-tinyllama-1.1b-16384-instructions-GGUF

Quantized GGUF model files for malaysian-tinyllama-1.1b-16384-instructions from mesolitica

Name Quant method Size
malaysian-tinyllama-1.1b-16384-instructions.q2_k.gguf q2_k 482.14 MB
malaysian-tinyllama-1.1b-16384-instructions.q3_k_m.gguf q3_k_m 549.85 MB
malaysian-tinyllama-1.1b-16384-instructions.q4_k_m.gguf q4_k_m 667.81 MB
malaysian-tinyllama-1.1b-16384-instructions.q5_k_m.gguf q5_k_m 782.04 MB
malaysian-tinyllama-1.1b-16384-instructions.q6_k.gguf q6_k 903.41 MB
malaysian-tinyllama-1.1b-16384-instructions.q8_0.gguf q8_0 1.17 GB

Original Model Card:

Downloads last month
90
GGUF
Model size
1.1B params
Architecture
llama
Hardware compatibility
Log In to view the estimation

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for afrideva/malaysian-tinyllama-1.1b-16384-instructions-GGUF

Base model

mesolitica/malaysian-tinyllama-1.1b-16k-instructions
Quantized
(2)
this model

Collection including afrideva/malaysian-tinyllama-1.1b-16384-instructions-GGUF