---
license: apache-2.0
datasets:
- adamo1139/HESOYAM_v0.3
- adamo1139/uninstruct-v1-experimental-chatml
- adamo1139/rawrr_v2-1-stage2
tags:
- orpo
---
## Basic Model Info
1 epoch on adamo1139/uninstruct-v1-experimental-chatml, then 1 epoch on adamo1139/HESOYAM_v0.3, then a fraction of an epoch on adamo1139/rawrr_v2-1-stage2. I used [GaLore](https://arxiv.org/abs/2403.03507) for all three stages.

After I saw that adamo1139/Yi-34B-200K-HESOYAM-2206 is not free of slop if you don't use the right prompt, I decided to try to ORPO it out using adamo1139/rawrr_v2-1-stage2.

The effects are mixed - it's pleasant to talk to, it doesn't really feel like you're exchanging comments on reddit/4chan anymore. It's very easy to have a nice human-like discussion with it, it has potential.

Prompt format is ChatML, not sure which system prompt works best.