metadata
library_name: transformers
datasets:
- HuggingFaceH4/ultrafeedback_binarized
base_model:
- princeton-nlp/Llama-3-Base-8B-SFT
This model is fine-tuned from the princeton-nlp/Llama-3-Base-8B-SFT model using the SelectiveDPO on the Ultrafeedback_binarized dataset.
For the recipe to reproduce this model, please visit our GitHub page.