Update README.md

README.md

@@ -16,6 +16,9 @@ should probably proofread and complete it, then remove this comment. -->
 
 # qwen-2-7b-dpo-ultrafeedback-5e-7-SFTed-paged_adamw_32bit-fixed-0.95
 
+This is a model released from the preprint: [DPO-Shift: Shifting the Distribution of Direct Preference Optimization](https://arxiv.org/abs/2502.07599). Please refer to our [repository](https://github.com/Meaquadddd/DPO-Shift) for more details.
+
+
 This model is a fine-tuned version of [NoManDeRY/DPO-Shift-Qwen-2-7B-UltraChat200K-SFT](https://huggingface.co/NoManDeRY/DPO-Shift-Qwen-2-7B-UltraChat200K-SFT) on the HuggingFaceH4/ultrafeedback_binarized dataset.
 It achieves the following results on the evaluation set:
 - Loss: 0.5890