Update README.md
Browse files
README.md
CHANGED
|
@@ -2,4 +2,11 @@
|
|
| 2 |
license: apache-2.0
|
| 3 |
---
|
| 4 |
|
| 5 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 2 |
license: apache-2.0
|
| 3 |
---
|
| 4 |
|
| 5 |
+
Please note: This model is not the official implementation from [AutoAWQ](https://github.com/casper-hansen/AutoAWQ). Instead, it is a Qwen3 implementation featuring scales assigned per expert.
|
| 6 |
+
To run this model, you will need to install and use the `kishizaki-sci` version of AutoAWQ in your environment.
|
| 7 |
+
```bash
|
| 8 |
+
git clone -b qwen3_moe https://github.com/kIshizaki-sci/AutoAWQ.git
|
| 9 |
+
pip install -e ./AutoAWQ
|
| 10 |
+
```
|
| 11 |
+
quantization : https://colab.research.google.com/drive/1FRWZBiWDYeNrVx6pOQEB24tJK8EGkZoR?usp=sharing
|
| 12 |
+
inference : https://colab.research.google.com/drive/1yN21HjT7v695voETVYa6qYsraeNW-8Cy?usp=sharing
|