File size: 273 Bytes
8629a8b |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 |
---
tags:
- gguf
---
This repository hosts GGUF-IQ-Imatrix quantizations for [ResplendentAI/Datura_7B](https://huggingface.co/ResplendentAI/Datura_7B).
**This is experimental.**
```python
quantization_options = [
"Q4_K_M", "Q5_K_M", "Q6_K", "Q8_0"
]
```
|