metadata
datasets:
- c-s-ale/alpaca-gpt4-data
- Open-Orca/OpenOrca
- Intel/orca_dpo_pairs
- allenai/ultrafeedback_binarized_cleaned
- HuggingFaceH4/no_robots
license: cc-by-nc-4.0
language:
- en
library_name: ExLlamaV2
pipeline_tag: text-generation
tags:
- Mistral
- SOLAR
- Quantized Model
- exl2
base_model:
- rishiraj/meow
exl2 quants for meow
This repository includes the quantized models for the meow model by Rishiraj Acharya. meow is a fine-tune of SOLAR-10.7B-Instruct-v1.0 with the no_robots dataset.
Current models
| exl2 BPW | Model Branch | Model Size |
|---|---|---|
| 2-Bit | main | N/A |
| 4-Bit | 4bit | N/A |
| 5-Bit | 5bit | N/A |
| 6-Bit | 6bit | 8.23 GB |
| 8-Bit | 8bit | N/A |
Where to use
There are a couple places you can use an exl2 model, here are a few: