| license: unknown | |
| awq quant made with [lmdeploy](https://github.com/InternLM/lmdeploy) v0.4.2: | |
| ``` | |
| lmdeploy lite auto_awq sophosympatheia/Midnight-Miqu-70B-v1.5 --work-dir Midnight-Miqu-70B-v1.5-4bit | |
| ``` |
| license: unknown | |
| awq quant made with [lmdeploy](https://github.com/InternLM/lmdeploy) v0.4.2: | |
| ``` | |
| lmdeploy lite auto_awq sophosympatheia/Midnight-Miqu-70B-v1.5 --work-dir Midnight-Miqu-70B-v1.5-4bit | |
| ``` |