NoManDeRY commited on
Commit
bf80f5a
·
verified ·
1 Parent(s): 32605e0

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -16,7 +16,7 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  # qwen-2-7b-dpo-ultrafeedback-5e-7-SFTed-paged_adamw_32bit-fixed-0.95
18
 
19
- This model is a fine-tuned version of [/data/workdir/zl/save_sft/qwen-2-7b-sft-ultrachat_200k-2e-5-paged_adamw_32bit](https://huggingface.co//data/workdir/zl/save_sft/qwen-2-7b-sft-ultrachat_200k-2e-5-paged_adamw_32bit) on the HuggingFaceH4/ultrafeedback_binarized dataset.
20
  It achieves the following results on the evaluation set:
21
  - Loss: 0.5890
22
  - Rewards/chosen: -0.0170
 
16
 
17
  # qwen-2-7b-dpo-ultrafeedback-5e-7-SFTed-paged_adamw_32bit-fixed-0.95
18
 
19
+ This model is a fine-tuned version of [NoManDeRY/DPO-Shift-Qwen-2-7B-UltraChat200K-SFT](https://huggingface.co/NoManDeRY/DPO-Shift-Qwen-2-7B-UltraChat200K-SFT) on the HuggingFaceH4/ultrafeedback_binarized dataset.
20
  It achieves the following results on the evaluation set:
21
  - Loss: 0.5890
22
  - Rewards/chosen: -0.0170