File size: 641 Bytes
5a13ece 8548719 |
1 2 3 4 5 6 7 8 9 10 11 12 |
---
license: apache-2.0
---
Please note: This model is not the official implementation from [AutoAWQ](https://github.com/casper-hansen/AutoAWQ). Instead, it is a Qwen3 implementation featuring scales assigned per expert.
To run this model, you will need to install and use the `kishizaki-sci` version of AutoAWQ in your environment.
```bash
git clone -b qwen3_moe https://github.com/kIshizaki-sci/AutoAWQ.git
pip install -e ./AutoAWQ
```
quantization : https://colab.research.google.com/drive/1FRWZBiWDYeNrVx6pOQEB24tJK8EGkZoR?usp=sharing
inference : https://colab.research.google.com/drive/1yN21HjT7v695voETVYa6qYsraeNW-8Cy?usp=sharing |