metadata
license: apache-2.0
base_model: rinna/qwen2.5-bakeneko-32b
base_model_relation: quantized
language:
- ja
- en
Using turboderp's ExLlamaV2 v0.2.8 for quantization.
2.2bpw
3.0bpw
4.0bpw
5.0bpw
6.0bpw
7.0bpw
8.0bpw
Calibration Dataset
TFMC/imatrix-dataset-for-japanese-llm
qwen2.5-bakeneko-32b-exl2
- Model creator: rinna
- Original model: qwen2.5-bakeneko-32b