mav23 commited on
Commit
100e022
·
verified ·
1 Parent(s): e315f80

Upload folder using huggingface_hub

Browse files
Files changed (3) hide show
  1. .gitattributes +1 -0
  2. README.md +47 -0
  3. qwen-modelstock2-15b.Q4_0.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ qwen-modelstock2-15b.Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,47 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - allknowingroger/Qwenslerp2-14B
4
+ - rombodawg/Rombos-LLM-V2.6-Qwen-14b
5
+ - allknowingroger/Qwenslerp3-14B
6
+ - allknowingroger/Qwen2.5-slerp-14B
7
+ - allknowingroger/Qwen-modelstock-15B
8
+ library_name: transformers
9
+ tags:
10
+ - mergekit
11
+ - merge
12
+ license: apache-2.0
13
+ ---
14
+ # merge
15
+
16
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
17
+
18
+ ## Merge Details
19
+ ### Merge Method
20
+
21
+ This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [allknowingroger/Qwenslerp2-14B](https://huggingface.co/allknowingroger/Qwenslerp2-14B) as a base.
22
+
23
+ ### Models Merged
24
+
25
+ The following models were included in the merge:
26
+ * [rombodawg/Rombos-LLM-V2.6-Qwen-14b](https://huggingface.co/rombodawg/Rombos-LLM-V2.6-Qwen-14b)
27
+ * [allknowingroger/Qwenslerp3-14B](https://huggingface.co/allknowingroger/Qwenslerp3-14B)
28
+ * [allknowingroger/Qwen2.5-slerp-14B](https://huggingface.co/allknowingroger/Qwen2.5-slerp-14B)
29
+ * [allknowingroger/Qwen-modelstock-15B](https://huggingface.co/allknowingroger/Qwen-modelstock-15B)
30
+
31
+ ### Configuration
32
+
33
+ The following YAML configuration was used to produce this model:
34
+
35
+ ```yaml
36
+ models:
37
+ - model: allknowingroger/Qwen-modelstock-15B
38
+ - model: allknowingroger/Qwenslerp3-14B
39
+ - model: allknowingroger/Qwen2.5-slerp-14B
40
+ - model: rombodawg/Rombos-LLM-V2.6-Qwen-14b
41
+ merge_method: model_stock
42
+ base_model: allknowingroger/Qwenslerp2-14B
43
+ normalize: false
44
+ int8_mask: true
45
+ dtype: bfloat16
46
+
47
+ ```
qwen-modelstock2-15b.Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fce07208dc6b3012e556df2934e67cf2bf430c8ad25fbf17e3aaea5eb98dcb55
3
+ size 8517726848