Aligning to Thousands of Preferences via System Message Generalization
Paper
•
2405.17977
•
Published
•
7
System Message Generalization
-
-
kaist-ai/Multifaceted-Collection
Viewer • Updated • 197k • 90 • 15 -
kaist-ai/janus-7b
Text Generation • Updated • 34 • 8 -
kaist-ai/Multifaceted-Bench
Viewer • Updated • 921 • 84 • 6 -
kaist-ai/Multifaceted-Collection-DPO
Viewer • Updated • 65.1k • 57 • 9 -
kaist-ai/janus-dpo-7b
Text Generation • Updated • 16 • 3 -
kaist-ai/Multifaceted-Collection-ORPO
Viewer • Updated • 64.6k • 70 • 10 -
kaist-ai/janus-orpo-7b
Text Generation • Updated • 1.02k • 2 -
kaist-ai/Multifaceted-Collection-RM
Viewer • Updated • 64.9k • 126 • 4 -
kaist-ai/janus-rm-7b
Updated • 83 • 4 -
kaist-ai/Multifaceted-Collection-small
Viewer • Updated • 65.7k • 31 • 5