Hugging Face's logo

cecibas
/
Midnight-Miqu-70B-v1.5-4bit

Text Generation
Transformers
PyTorch
llama
conversational
text-generation-inference
Inference Endpoints
4-bit precision
awq
Model card Files Community
1
cecibas commited on
Commit
8bd8b19
·
verified ·
1 Parent(s): b228e09

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -1,7 +1,7 @@
1
  ---
2
  license: unknown
3
  ---
4
- awq quant made with [lmdeploy](https://github.com/InternLM/lmdeploy):
5
  ```
6
  lmdeploy lite auto_awq sophosympatheia/Midnight-Miqu-70B-v1.5 --work-dir Midnight-Miqu-70B-v1.5-4bit
7
  ```
 
1
  ---
2
  license: unknown
3
  ---
4
+ awq quant made with [lmdeploy](https://github.com/InternLM/lmdeploy) v0.4.2:
5
  ```
6
  lmdeploy lite auto_awq sophosympatheia/Midnight-Miqu-70B-v1.5 --work-dir Midnight-Miqu-70B-v1.5-4bit
7
  ```