---
base_model: grimjim/MagTie-v1-12B
base_model_relation: quantized
quanted_by: grimjim
library_name: transformers
license: apache-2.0
pipeline_tag: text-generation
tags:
- mergekit
- merge
- GGUF
---
# MagTie-v1-12B-GGUF

This repo is a set of GGUF quants of a [grimjim/MagTie-v1-12B](https://huggingface.co/grimjim/MagTie-v1-12B), a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).

[llama.cpp](https://github.com/ggerganov/llama.cpp/) was used to make the following quants:

- [Q4_0](MagTie-v1-12B.Q4_0.gguf)
- [Q4_K_M](MagTie-v1-12B.Q4_K_M.gguf)
- [Q5_K_M](MagTie-v1-12B.Q5_K_M.gguf)
- [Q6_K](MagTie-v1-12B.Q6_K.gguf)
- [Q8_0](MagTie-v1-12B.Q8_0.gguf)