A finetuning experiment on llama3 8b it with selected 5k examples from argilla dpo 7k
- Downloads last month
- 4
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for eren23/DPOMixLLama-3-8B-lora
Base model
meta-llama/Meta-Llama-3-8B-Instruct