Create README.md

README.md

@@ -0,0 +1,27 @@
+---
+model-index:
+- name: Junrulu/FIPO-IPL-IPO-Tulu2-70B
+  results: []
+datasets:
+- Junrulu/Prompt_Preference_Dataset
+language:
+- en
+base_model: allenai/tulu-2-dpo-70b
+---
+
+# Model Card for FIPO-IPL-IPO-Tulu2-70B
+
+Our repository: https://github.com/LuJunru/FIPO_Project.
+
+Our paper: https://arxiv.org/abs/2402.11811.
+
+## Input Format
+
+The model is trained to use the following format (note the newlines):
+```
+<|user|>
+Your message here!
+<|assistant|>
+```
+
+For best results, format all inputs in this manner. **Make sure to include a newline after `<|assistant|>`, this can affect generation quality quite a bit.**