prithivMLmods
/

Llama-3.2-1B-Instruct-f32-GGUF

Text Generation

text-generation-inference

Model card Files Files and versions

Llama-3.2-1B-Instruct-f32-GGUF

18.3 GB

1 contributor

History: 6 commits

prithivMLmods's picture

Update README.md

ac43e34 verified 3 months ago

.gitattributes

2.42 kB

Upload folder using huggingface_hub 3 months ago
Llama-3.2-1B-Instruct.BF16.gguf

2.48 GB
xet

Upload folder using huggingface_hub 3 months ago
Llama-3.2-1B-Instruct.F16.gguf

2.48 GB
xet

Upload folder using huggingface_hub 3 months ago
Llama-3.2-1B-Instruct.F32.gguf

4.95 GB
xet

Upload folder using huggingface_hub 3 months ago
Llama-3.2-1B-Instruct.Q2_K.gguf

581 MB
xet

Upload folder using huggingface_hub 3 months ago
Llama-3.2-1B-Instruct.Q3_K_L.gguf

733 MB
xet

Upload folder using huggingface_hub 3 months ago
Llama-3.2-1B-Instruct.Q3_K_M.gguf

691 MB
xet

Upload folder using huggingface_hub 3 months ago
Llama-3.2-1B-Instruct.Q3_K_S.gguf

642 MB
xet

Upload folder using huggingface_hub 3 months ago
Llama-3.2-1B-Instruct.Q4_K_M.gguf

808 MB
xet

Upload folder using huggingface_hub 3 months ago
Llama-3.2-1B-Instruct.Q4_K_S.gguf

776 MB
xet

Upload folder using huggingface_hub 3 months ago
Llama-3.2-1B-Instruct.Q5_K_M.gguf

912 MB
xet

Upload folder using huggingface_hub 3 months ago
Llama-3.2-1B-Instruct.Q5_K_S.gguf

893 MB
xet

Upload folder using huggingface_hub 3 months ago
Llama-3.2-1B-Instruct.Q6_K.gguf

1.02 GB
xet

Upload folder using huggingface_hub 3 months ago
Llama-3.2-1B-Instruct.Q8_0.gguf

1.32 GB
xet

Upload folder using huggingface_hub 3 months ago
README.md

2.19 kB

Update README.md 3 months ago
config.json

29 Bytes

Upload folder using huggingface_hub 3 months ago