Hugging Face's logo

Eshita-ds
/
Llama-3.2-1B-DPO-DPO-GRPO

Transformers
Safetensors
English
text-generation-inference
unsloth
llama
trl
Model card Files Community

Uploaded model

  • Developed by: Eshita-ds
  • License: apache-2.0
  • Finetuned from model : Eshita-ds/Llama-3.2-1B-DPO

This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Eshita-ds/Llama-3.2-1B-DPO-DPO-GRPO

Unable to build the model tree, the base model loops to the model itself. Learn more.