merge

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the Model Noiser merge method.

Models Merged

The following models were included in the merge:

Configuration

The following YAML configuration was used to produce this model:

merge_method: model_noiser
models:
  - model: Qwen/Qwen2.5-0.5B-Instruct
parameters:
  normalize: true
  noise_stddev: 0.02  # adjust as needed

WARNING

The YAML config used does NOT work in mergekit normally. You need my fork for this.

Downloads last month
15
Safetensors
Model size
494M params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for stupidity-ai/Qwen2.5-0.5B-Noised2.0

Base model

Qwen/Qwen2.5-0.5B
Finetuned
(364)
this model