Configuration Parsing
Warning:
In config.json: "quantization_config.bits" must be an integer
Llama3-70B-Orion-Chinese-4bpw-exl2
这是对Orion-zhen/Llama3-70B-Orion-Chinese的exl2 4bpw量化版
采用Orion-zhen/firefly-exl-calibration作为校准数据集, 以获得较少的中文性能损失并降低出现乱码的概率
- Downloads last month
- 15
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support