metadata
library_name: peft
license: apache-2.0
base_model: unsloth/SmolLM-360M-Instruct
tags:
- axolotl
- generated_from_trainer
model-index:
- name: fcef08cb-0f5e-44e1-ba45-9c886c47afab
results: []
fcef08cb-0f5e-44e1-ba45-9c886c47afab
This model is a fine-tuned version of unsloth/SmolLM-360M-Instruct on the None dataset. It achieves the following results on the evaluation set:
- Loss: 1.1086
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
Training results
| Training Loss | Epoch | Step | Validation Loss |
|---|---|---|---|
| No log | 0.0001 | 1 | 2.4945 |
| 1.3824 | 0.0099 | 150 | 1.2470 |
| 1.2402 | 0.0198 | 300 | 1.1689 |
| 1.2303 | 0.0297 | 450 | 1.1432 |
| 1.2022 | 0.0397 | 600 | 1.1312 |
| 1.2091 | 0.0496 | 750 | 1.1212 |
| 1.1716 | 0.0595 | 900 | 1.1158 |
| 1.1557 | 0.0694 | 1050 | 1.1122 |
| 1.1727 | 0.0793 | 1200 | 1.1093 |
| 1.2705 | 0.0892 | 1350 | 1.1086 |
Framework versions
- PEFT 0.13.2
- Transformers 4.46.0
- Pytorch 2.5.0+cu124
- Datasets 3.0.1
- Tokenizers 0.20.1