JunHowie's picture
Upload folder using huggingface_hub
970b079 verified

license: apache-2.0

通义千问Qwen3-30B-A3B-GPTQ-Int4量化

基础模型 通义千问3-30B-A3B

最近更新

2025-05-08
fix (model.layers.*.mlp.gate) are not quantized

依赖

vllm==0.8.5

SDK下载

#安装ModelScope
pip install modelscope
#SDK模型下载
from modelscope import snapshot_download
model_dir = snapshot_download('JunHowie/Qwen3-30B-A3B-GPTQ-Int4')

Git下载

#Git模型下载
git clone https://www.modelscope.cn/JunHowie/Qwen3-30B-A3B-GPTQ-Int4.git

如果您是本模型的贡献者,我们邀请您根据模型贡献文档,及时完善模型卡片内容。