ca-youri-7B-merge-MoE-slerp

ca-youri-7B-merge-MoE-slerp is a merge of the following models using mergekit:

๐Ÿงฉ Configuration

base_model: cyberagent/calm2-7b-chat
gate_mode: hidden
dtype: bfloat16
experts:
  - source_model: cyberagent/calm2-7b-chat
    positive_prompts: 
      - "่ณชๅ•ใจๅ›ž็ญ”ใฎ้ธๆŠž่‚ขใ‚’ๅ…ฅๅŠ›ใจใ—ใฆๅ—ใ‘ๅ–ใ‚Šใ€้ธๆŠž่‚ขใ‹ใ‚‰ๅ›ž็ญ”ใ‚’้ธๆŠžใ—ใฆใใ ใ•ใ„ใ€‚"
      - "ๅ‰ๆใจไปฎ่ชฌใฎ้–ขไฟ‚ใ‚’ๅซๆ„ใ€็Ÿ›็›พใ€ไธญ็ซ‹ใฎไธญใ‹ใ‚‰ๅ›ž็ญ”ใ—ใฆใใ ใ•ใ„ใ€‚"
      - "ไปฅไธ‹ใฎใƒ†ใ‚ญใ‚นใƒˆใ‚’ใ€ใƒใ‚ธใƒ†ใ‚ฃใƒ–ใพใŸใฏใƒใ‚ฌใƒ†ใ‚ฃใƒ–ใฎๆ„Ÿๆƒ…ใ‚ฏใƒฉใ‚นใฎใ„ใšใ‚Œใ‹ใซๅˆ†้กžใ—ใฆใใ ใ•ใ„ใ€‚"
      - "ไปฅไธ‹ใฏใ€ใ‚ฟใ‚นใ‚ฏใ‚’่ชฌๆ˜Žใ™ใ‚‹ๆŒ‡็คบใจใ€ๆ–‡่„ˆใฎใ‚ใ‚‹ๅ…ฅๅŠ›ใฎ็ต„ใฟๅˆใ‚ใ›ใงใ™ใ€‚่ฆๆฑ‚ใ‚’้ฉๅˆ‡ใซๆบ€ใŸใ™ๅฟœ็ญ”ใ‚’ๆ›ธใใชใ•ใ„ใ€‚"
  - source_model: rinna/youri-7b-instruction
    positive_prompts: 
     - "่ณชๅ•ใซๅฏพใ™ใ‚‹ๅ›ž็ญ”ใ‚’้กŒๅใจๆ–‡็ซ ใ‹ใ‚‰ไธ€่จ€ใงๆŠฝๅ‡บใ—ใฆใใ ใ•ใ„ใ€‚ๅ›ž็ญ”ใฏๅ่ฉžใง็ญ”ใˆใฆใใ ใ•ใ„ใ€‚"
     - "ไธŽใˆใ‚‰ใ‚ŒใŸใƒ‹ใƒฅใƒผใ‚น่จ˜ไบ‹ใ‚’่ฆ็ด„ใ—ใฆใใ ใ•ใ„ใ€‚"
     - "ไธŽใˆใ‚‰ใ‚ŒใŸๆ–‡ใŒๆ–‡ๆณ•็š„ใงใ‚ใ‚‹ใ‹ใ‚’ๅ›ž็ญ”ใ—ใฆใใ ใ•ใ„ใ€‚"
Downloads last month
18
Safetensors
Model size
11.3B params
Tensor type
BF16
ยท
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.

Model tree for ayousanz/ca-youri-7B-merge-MoE-slerp