cecibas
/

Midnight-Miqu-70B-v1.5-4bit

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Midnight-Miqu-70B-v1.5-4bit / README.md

cecibas's picture

Update README.md

8bd8b19 verified 8 months ago

|

history blame contribute delete

210 Bytes

metadata

license: unknown

awq quant made with lmdeploy v0.4.2:

lmdeploy lite auto_awq sophosympatheia/Midnight-Miqu-70B-v1.5 --work-dir Midnight-Miqu-70B-v1.5-4bit