asiansoul commited on
Commit
42a8417
ยท
verified ยท
1 Parent(s): 29a809d

Delete mergekit_config.yml

Browse files
Files changed (1) hide show
  1. mergekit_config.yml +0 -15
mergekit_config.yml DELETED
@@ -1,15 +0,0 @@
1
- merge_method: dare_ties
2
- base_model: NousResearch/Meta-Llama-3.1-8B-Instruct # ๋ฒ ์ด์Šค ๋ชจ๋ธ ์ˆ˜์ •
3
- models:
4
- - model: "deepseek-ai/DeepSeek-R1-Distill-Llama-8B"
5
- parameters:
6
- density: 0.55 # ์ˆ˜ํ•™/์ฝ”๋”ฉ ํŠนํ™” ํŒŒ๋ผ๋ฏธํ„ฐ ๋ณด์กด๋ฅ  โ†‘
7
- weight: 0.35
8
- - model: "sh2orc/Llama-3.1-Korean-8B-Instruct" # Llama-3.1 ๊ธฐ๋ฐ˜
9
- parameters:
10
- density: 0.75 # ํ•œ๊ตญ์–ด ํŒŒ๋ผ๋ฏธํ„ฐ ์ตœ๋Œ€ํ•œ ๋ณดํ˜ธ
11
- weight: 0.65
12
- tokenizer_source: "sh2orc/Llama-3.1-Korean-8B-Instruct" # ํ•œ๊ธ€์— ์ตœ์ ํ™”๋œ ํ† ํฌ๋‚˜์ด์ € ์‚ฌ์šฉ
13
- dtype: bfloat16
14
- int8_mask: true
15
-