image/png

Prompt format: ChatML

<|im_start|>system
{system_prompt}<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant

Instruct/Context import + Textgen preset combined available: Presets Here

ST Example:

image/png

The following YAML configuration was used to produce this model:

slices:
  - sources:
      - model: Nitral-AI/Nera_Noctis-12B-v0.420
        layer_range: [0, 40]
      - model: Nitral-AI/Captain-Eris-Diogenes_Twilight-V0.420-12B
        layer_range: [0, 40]
merge_method: slerp
base_model: Nitral-AI/Nera_Noctis-12B-v0.420
parameters:
  t:
    - filter: self_attn
      value: [0, 0.5, 0.3, 0.7, 1]
    - filter: mlp
      value: [1, 0.5, 0.7, 0.3, 0]
    - value: 0.420
dtype: bfloat16
Downloads last month
140
Safetensors
Model size
12.2B params
Tensor type
BF16
·
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for Nitral-AI/Captain_Eris_Noctis-12B-v0.420

Collection including Nitral-AI/Captain_Eris_Noctis-12B-v0.420