metadata

datasets:
  - c-s-ale/alpaca-gpt4-data
  - Open-Orca/OpenOrca
  - Intel/orca_dpo_pairs
  - allenai/ultrafeedback_binarized_cleaned
  - HuggingFaceH4/no_robots
license: cc-by-nc-4.0
language:
  - en
library_name: ExLlamaV2
pipeline_tag: text-generation
tags:
  - Mistral
  - SOLAR
  - Quantized Model
  - exl2
base_model:
  - rishiraj/meow

exl2 quants for meow

This repository includes the quantized models for the meow model by Rishiraj Acharya. meow is a fine-tune of SOLAR-10.7B-Instruct-v1.0 with the no_robots dataset.

Current models

exl2 BPW	Model Branch	Model Size
2-Bit	main	N/A
4-Bit	4bit	N/A
5-Bit	5bit	N/A
6-Bit	6bit	8.23 GB
8-Bit	8bit	N/A

Where to use

There are a couple places you can use an exl2 model, here are a few:

oobabooga's Text Gen Webui
tabbyAPI
ExUI
KoboldAI (Clone repo, don't use snapshot)

WARNING

Model cannot be used commercially due to the Alpaca dataset license.