bartowski
/

nvidia_NVIDIA-Nemotron-Nano-12B-v2-GGUF

Text Generation

Model card Files Files and versions

nvidia_NVIDIA-Nemotron-Nano-12B-v2-GGUF

Ctrl+K

Ctrl+K

1 contributor

History: 29 commits

bartowski's picture

Update metadata with huggingface_hub

3b29fb4 verified 4 days ago

.gitattributes

3.67 kB

Upload nvidia_NVIDIA-Nemotron-Nano-12B-v2-imatrix.gguf with huggingface_hub 4 days ago
README.md

14.8 kB

Update metadata with huggingface_hub 4 days ago
nvidia_NVIDIA-Nemotron-Nano-12B-v2-IQ2_M.gguf

4.38 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-12B-v2-IQ2_M.gguf with huggingface_hub 4 days ago
nvidia_NVIDIA-Nemotron-Nano-12B-v2-IQ2_S.gguf

4.07 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-12B-v2-IQ2_S.gguf with huggingface_hub 4 days ago
nvidia_NVIDIA-Nemotron-Nano-12B-v2-IQ3_M.gguf

5.69 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-12B-v2-IQ3_M.gguf with huggingface_hub 4 days ago
nvidia_NVIDIA-Nemotron-Nano-12B-v2-IQ3_XS.gguf

5.46 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-12B-v2-IQ3_XS.gguf with huggingface_hub 4 days ago
nvidia_NVIDIA-Nemotron-Nano-12B-v2-IQ3_XXS.gguf

4.96 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-12B-v2-IQ3_XXS.gguf with huggingface_hub 4 days ago
nvidia_NVIDIA-Nemotron-Nano-12B-v2-IQ4_NL.gguf

7.11 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-12B-v2-IQ4_NL.gguf with huggingface_hub 4 days ago
nvidia_NVIDIA-Nemotron-Nano-12B-v2-IQ4_XS.gguf

6.75 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-12B-v2-IQ4_XS.gguf with huggingface_hub 4 days ago
nvidia_NVIDIA-Nemotron-Nano-12B-v2-Q2_K.gguf

4.7 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-12B-v2-Q2_K.gguf with huggingface_hub 4 days ago
nvidia_NVIDIA-Nemotron-Nano-12B-v2-Q2_K_L.gguf

5.36 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-12B-v2-Q2_K_L.gguf with huggingface_hub 4 days ago
nvidia_NVIDIA-Nemotron-Nano-12B-v2-Q3_K_L.gguf

6.37 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-12B-v2-Q3_K_L.gguf with huggingface_hub 4 days ago
nvidia_NVIDIA-Nemotron-Nano-12B-v2-Q3_K_M.gguf

6.02 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-12B-v2-Q3_K_M.gguf with huggingface_hub 4 days ago
nvidia_NVIDIA-Nemotron-Nano-12B-v2-Q3_K_S.gguf

5.57 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-12B-v2-Q3_K_S.gguf with huggingface_hub 4 days ago
nvidia_NVIDIA-Nemotron-Nano-12B-v2-Q3_K_XL.gguf

6.96 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-12B-v2-Q3_K_XL.gguf with huggingface_hub 4 days ago
nvidia_NVIDIA-Nemotron-Nano-12B-v2-Q4_0.gguf

7.16 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-12B-v2-Q4_0.gguf with huggingface_hub 4 days ago
nvidia_NVIDIA-Nemotron-Nano-12B-v2-Q4_1.gguf

7.84 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-12B-v2-Q4_1.gguf with huggingface_hub 4 days ago
nvidia_NVIDIA-Nemotron-Nano-12B-v2-Q4_K_L.gguf

7.99 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-12B-v2-Q4_K_L.gguf with huggingface_hub 4 days ago
nvidia_NVIDIA-Nemotron-Nano-12B-v2-Q4_K_M.gguf

7.49 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-12B-v2-Q4_K_M.gguf with huggingface_hub 4 days ago
nvidia_NVIDIA-Nemotron-Nano-12B-v2-Q4_K_S.gguf

7.21 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-12B-v2-Q4_K_S.gguf with huggingface_hub 4 days ago
nvidia_NVIDIA-Nemotron-Nano-12B-v2-Q5_K_L.gguf

9.18 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-12B-v2-Q5_K_L.gguf with huggingface_hub 4 days ago
nvidia_NVIDIA-Nemotron-Nano-12B-v2-Q5_K_M.gguf

8.76 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-12B-v2-Q5_K_M.gguf with huggingface_hub 4 days ago
nvidia_NVIDIA-Nemotron-Nano-12B-v2-Q5_K_S.gguf

8.57 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-12B-v2-Q5_K_S.gguf with huggingface_hub 4 days ago
nvidia_NVIDIA-Nemotron-Nano-12B-v2-Q6_K.gguf

10.1 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-12B-v2-Q6_K.gguf with huggingface_hub 4 days ago
nvidia_NVIDIA-Nemotron-Nano-12B-v2-Q6_K_L.gguf

10.4 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-12B-v2-Q6_K_L.gguf with huggingface_hub 4 days ago
nvidia_NVIDIA-Nemotron-Nano-12B-v2-Q8_0.gguf

13.1 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-12B-v2-Q8_0.gguf with huggingface_hub 4 days ago
nvidia_NVIDIA-Nemotron-Nano-12B-v2-bf16.gguf

24.6 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-12B-v2-bf16.gguf with huggingface_hub 4 days ago
nvidia_NVIDIA-Nemotron-Nano-12B-v2-imatrix.gguf

5.1 MB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-12B-v2-imatrix.gguf with huggingface_hub 4 days ago