Vikhr-Nemo fine-tuned with contrastive Russian literature.
- Base model: https://huggingface.co/Vikhrmodels/Vikhr-Nemo-12B-Instruct-R-21-09-24
- Dataset: https://huggingface.co/datasets/40umov/dostoevsky
- Method: ORPO
- Training config: https://github.com/IlyaGusev/saiga/blob/main/configs/models/doestoevsky_nemo_12b_orpo_m1.json
- WandB: https://wandb.ai/ilyagusev/rulm_self_instruct/runs/4v4pcgej
- Downloads last month
- 39
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
HF Inference API was unable to determine this model’s pipeline type.
Model tree for IlyaGusev/vikhr_nemo_orpo_dostoevsky_12b
Base model
mistralai/Mistral-Nemo-Base-2407
Finetuned
mistralai/Mistral-Nemo-Instruct-2407