--- base_model: - crestf411/gemma2-9B-sunfall-v0.5.2 - Hastagaras/Gemma-Model1 - IlyaGusev/gemma-2-9b-it-abliterated - Hastagaras/Gemmoy-9B-G2-MK.3 library_name: transformers tags: - mergekit - merge --- # model This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [IlyaGusev/gemma-2-9b-it-abliterated](https://huggingface.co/IlyaGusev/gemma-2-9b-it-abliterated) as a base. ### Models Merged The following models were included in the merge: * [crestf411/gemma2-9B-sunfall-v0.5.2](https://huggingface.co/crestf411/gemma2-9B-sunfall-v0.5.2) * [Hastagaras/Gemma-Model1](https://huggingface.co/Hastagaras/Gemma-Model1) * [Hastagaras/Gemmoy-9B-G2-MK.3](https://huggingface.co/Hastagaras/Gemmoy-9B-G2-MK.3) ### Configuration The following YAML configuration was used to produce this model: ```yaml models: - model: crestf411/gemma2-9B-sunfall-v0.5.2 - model: Hastagaras/Gemmoy-9B-G2-MK.3 - model: Hastagaras/Gemma-Model1 merge_method: model_stock base_model: IlyaGusev/gemma-2-9b-it-abliterated dtype: bfloat16 ```