cecibas
/

Midnight-Miqu-70B-v1.5-4bit

Text Generation

Transformers

PyTorch

llama

conversational

text-generation-inference

Inference Endpoints

4-bit precision

awq

Model card Files Files and versions Community

awq quant made with lmdeploy v0.4.2:

lmdeploy lite auto_awq sophosympatheia/Midnight-Miqu-70B-v1.5 --work-dir Midnight-Miqu-70B-v1.5-4bit

Downloads last month: 661,154

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.