---
base_model:
- nvidia/Llama-3.1-Nemotron-Nano-8B-v1
---
GGUF quants of [nvidia/Llama-3.1-Nemotron-Nano-8B-v1](https://huggingface.co/nvidia/Llama-3.1-Nemotron-Nano-8B-v1)

Using llama.cpp b4920 (commit d84635b1b085d54d6a21924e6171688d6e3dfb46)

The importance matrix was generated with calibration_datav3.txt.

All quants were generated/calibrated with the imatrix, including the K quants.

Quantized from BF16.