--- license: apache-2.0 base_model: - Delta-Vector/Rei-24B-KTO base_model_relation: quantized pipeline_tag: text-generation library_name: safetensors tags: - KTO - roleplaying - prose - mistral - 24B - exl3 - 4-bit - 6-bit - 8-bit --- ## EXL3 quants: [ [H8-4.0BPW](https://huggingface.co/DeathGodlike/Rei-24B-KTO_EXL3/tree/H8-4.0BPW) | [H8-6.0BPW](https://huggingface.co/DeathGodlike/Rei-24B-KTO_EXL3/tree/H8-6.0BPW) | [H8-8.0BPW](https://huggingface.co/DeathGodlike/Rei-24B-KTO_EXL3/tree/H8-8.0BPW) ] # Original model: [Rei-24B-KTO](https://huggingface.co/Delta-Vector/Rei-24B-KTO) by [Delta-Vector](https://huggingface.co/Delta-Vector)