Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
JayHyeon
/
Qwen2.5-0.5B-SFT-2e-5-2ep-IRPO_5e-7-3ep_1alp_0lam
like
0
Text Generation
Transformers
Safetensors
trl-lib/ultrafeedback_binarized
qwen2
Generated from Trainer
trl
dpo
conversational
text-generation-inference
arxiv:
2305.18290
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
Qwen2.5-0.5B-SFT-2e-5-2ep-IRPO_5e-7-3ep_1alp_0lam
Commit History
End of training
8e123c0
verified
JayHyeon
commited on
Jan 2
Model save
14d09e2
verified
JayHyeon
commited on
Jan 2
Training in progress, step 2910
d52248f
verified
JayHyeon
commited on
Jan 2
Training in progress, step 2500
bd5e12f
verified
JayHyeon
commited on
Jan 2
Training in progress, step 2000
c8ec061
verified
JayHyeon
commited on
Jan 2
Training in progress, step 1500
faedb6d
verified
JayHyeon
commited on
Jan 2
Training in progress, step 1000
ea64578
verified
JayHyeon
commited on
Jan 2
Training in progress, step 500
13264b9
verified
JayHyeon
commited on
Jan 2
initial commit
ce4420a
verified
JayHyeon
commited on
Jan 2