Pre-DPO: Improving Data Utilization in Direct Preference Optimization Using a Guiding Reference Model
Paper
•
2504.15843
•
Published
•
18
Junjie Lu
Lux0926
AI & ML interests
None yet
Recent Activity
upvoted
a
paper
about 1 month ago
Exploring Data Scaling Trends and Effects in Reinforcement Learning from
Human Feedback
authored
a paper
2 months ago
ML-Bench: Large Language Models Leverage Open-source Libraries for
Machine Learning Tasks
Organizations
Lux0926's activity
upvoted
a
paper
14 days ago
upvoted
a
paper
about 1 month ago
authored
2
papers
2 months ago
Add dataset card with link to paper and source code
#1 opened 3 months ago
by
nielsr
Add paper link and task category
#1 opened 3 months ago
by
nielsr
upvoted
a
paper
3 months ago
updated
a
dataset
3 months ago
published
a
dataset
3 months ago
updated
7
datasets
3 months ago
Lux0926/ASPRM-BON-Evaluation-Dataset-Code
Preview
•
Updated
•
94
Lux0926/ASPRM-BON-Evaluation-Dataset-Math
Preview
•
Updated
•
192
Lux0926/ASPRM-MATHCODE-DeepSeek-Training-Dataset
Viewer
•
Updated
•
99.8k
•
14
Lux0926/ASPRM-MATHCODE-Mistral-Training-Dataset
Viewer
•
Updated
•
438k
•
17
Lux0926/ASPRM-D-Training-Dataset
Viewer
•
Updated
•
49.9k
•
19
Lux0926/ASPRM-L-Training-Dataset
Viewer
•
Updated
•
372k
•
16
Lux0926/ASPRM-D-Training-Dataset-ORM
Viewer
•
Updated
•
49.9k
•
13
updated
a
model
3 months ago
published
a
model
3 months ago
published
a
dataset
3 months ago
updated
a
dataset
3 months ago