---
base_model:
- nvidia/Llama-3.1-Nemotron-Nano-4B-v1.1
---
GGUF quants of [nvidia/Llama-3.1-Nemotron-Nano-4B-v1.1](https://huggingface.co/nvidia/Llama-3.1-Nemotron-Nano-4B-v1.1)

Using llama.cpp b5436 (commit be0239693c1530a18496086331fc18d8a9adbad1)

The importance matrix was generated with calibration_datav3.txt.

All quants were generated/calibrated with the imatrix, including the K quants.

Quantized from BF16.