jasperyeoh2
/

mistral-dpo-peft

preference-optimization

instruction-tuning

Model card Files Files and versions

mistral-dpo-peft / README.md

jasperyeoh2's picture

Create README.md

cae8908 verified 6 months ago

|

137 Bytes

metadata

datasets:
  - jasperyeoh2/pairrm-preference-dataset
  - GAIR/lima
base_model:
  - mistralai/Mistral-7B-Instruct-v0.2
tags:
  - PEFT
  - DPO