bartowski
/

nvidia_NVIDIA-Nemotron-Nano-9B-v2-GGUF

Text Generation

Model card Files Files and versions

nvidia_NVIDIA-Nemotron-Nano-9B-v2-GGUF

Ctrl+K

Ctrl+K

1 contributor

History: 27 commits

bartowski's picture

Upload nvidia_NVIDIA-Nemotron-Nano-9B-v2-imatrix.gguf with huggingface_hub

0f1fb6b verified 7 days ago

.gitattributes

3.64 kB

Upload nvidia_NVIDIA-Nemotron-Nano-9B-v2-imatrix.gguf with huggingface_hub 7 days ago
nvidia_NVIDIA-Nemotron-Nano-9B-v2-IQ2_M.gguf

5 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-9B-v2-IQ2_M.gguf with huggingface_hub 7 days ago
nvidia_NVIDIA-Nemotron-Nano-9B-v2-IQ2_S.gguf

4.96 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-9B-v2-IQ2_S.gguf with huggingface_hub 7 days ago
nvidia_NVIDIA-Nemotron-Nano-9B-v2-IQ3_M.gguf

5.21 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-9B-v2-IQ3_M.gguf with huggingface_hub 7 days ago
nvidia_NVIDIA-Nemotron-Nano-9B-v2-IQ3_XS.gguf

5.13 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-9B-v2-IQ3_XS.gguf with huggingface_hub 7 days ago
nvidia_NVIDIA-Nemotron-Nano-9B-v2-IQ3_XXS.gguf

5.07 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-9B-v2-IQ3_XXS.gguf with huggingface_hub 7 days ago
nvidia_NVIDIA-Nemotron-Nano-9B-v2-IQ4_NL.gguf

5.31 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-9B-v2-IQ4_NL.gguf with huggingface_hub 7 days ago
nvidia_NVIDIA-Nemotron-Nano-9B-v2-IQ4_XS.gguf

5.27 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-9B-v2-IQ4_XS.gguf with huggingface_hub 7 days ago
nvidia_NVIDIA-Nemotron-Nano-9B-v2-Q2_K.gguf

5.01 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-9B-v2-Q2_K.gguf with huggingface_hub 7 days ago
nvidia_NVIDIA-Nemotron-Nano-9B-v2-Q2_K_L.gguf

5.3 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-9B-v2-Q2_K_L.gguf with huggingface_hub 7 days ago
nvidia_NVIDIA-Nemotron-Nano-9B-v2-Q3_K_L.gguf

5.49 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-9B-v2-Q3_K_L.gguf with huggingface_hub 7 days ago
nvidia_NVIDIA-Nemotron-Nano-9B-v2-Q3_K_M.gguf

5.38 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-9B-v2-Q3_K_M.gguf with huggingface_hub 7 days ago
nvidia_NVIDIA-Nemotron-Nano-9B-v2-Q3_K_S.gguf

5.13 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-9B-v2-Q3_K_S.gguf with huggingface_hub 7 days ago
nvidia_NVIDIA-Nemotron-Nano-9B-v2-Q3_K_XL.gguf

5.78 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-9B-v2-Q3_K_XL.gguf with huggingface_hub 7 days ago
nvidia_NVIDIA-Nemotron-Nano-9B-v2-Q4_0.gguf

5.34 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-9B-v2-Q4_0.gguf with huggingface_hub 7 days ago
nvidia_NVIDIA-Nemotron-Nano-9B-v2-Q4_1.gguf

5.83 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-9B-v2-Q4_1.gguf with huggingface_hub 7 days ago
nvidia_NVIDIA-Nemotron-Nano-9B-v2-Q4_K_L.gguf

6.75 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-9B-v2-Q4_K_L.gguf with huggingface_hub 7 days ago
nvidia_NVIDIA-Nemotron-Nano-9B-v2-Q4_K_M.gguf

6.53 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-9B-v2-Q4_K_M.gguf with huggingface_hub 7 days ago
nvidia_NVIDIA-Nemotron-Nano-9B-v2-Q4_K_S.gguf

6.21 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-9B-v2-Q4_K_S.gguf with huggingface_hub 7 days ago
nvidia_NVIDIA-Nemotron-Nano-9B-v2-Q5_K_L.gguf

7.25 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-9B-v2-Q5_K_L.gguf with huggingface_hub 7 days ago
nvidia_NVIDIA-Nemotron-Nano-9B-v2-Q5_K_M.gguf

7.07 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-9B-v2-Q5_K_M.gguf with huggingface_hub 7 days ago
nvidia_NVIDIA-Nemotron-Nano-9B-v2-Q5_K_S.gguf

6.78 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-9B-v2-Q5_K_S.gguf with huggingface_hub 7 days ago
nvidia_NVIDIA-Nemotron-Nano-9B-v2-Q6_K.gguf

9.14 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-9B-v2-Q6_K.gguf with huggingface_hub 7 days ago
nvidia_NVIDIA-Nemotron-Nano-9B-v2-Q6_K_L.gguf

9.14 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-9B-v2-Q6_K_L.gguf with huggingface_hub 7 days ago
nvidia_NVIDIA-Nemotron-Nano-9B-v2-Q8_0.gguf

9.46 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-9B-v2-Q8_0.gguf with huggingface_hub 7 days ago
nvidia_NVIDIA-Nemotron-Nano-9B-v2-bf16.gguf

17.8 GB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-9B-v2-bf16.gguf with huggingface_hub 7 days ago
nvidia_NVIDIA-Nemotron-Nano-9B-v2-imatrix.gguf

3.92 MB
xet

Upload nvidia_NVIDIA-Nemotron-Nano-9B-v2-imatrix.gguf with huggingface_hub 7 days ago