--- base_model: - Qwen/Qwen2.5-0.5B-Instruct library_name: transformers tags: - mergekit - merge language: - zho - eng - fra - spa - por - deu - ita - rus - jpn - kor - vie - tha - ara --- # merge This is a merge of pre-trained language models created using a fork of [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [Model Noiser](https://example.com/docs) merge method. ### Models Merged The following models were included in the merge: * [Qwen/Qwen2.5-0.5B-Instruct](https://huggingface.co/Qwen/Qwen2.5-0.5B-Instruct) ### Configuration The following YAML configuration was used to produce this model: ```yaml merge_method: model_noiser models: - model: Qwen/Qwen2.5-0.5B-Instruct parameters: normalize: true noise_stddev: 0.0005 # adjust as needed ```