Thank you very much for this model, I have questions

#1
by NickyNicky - opened

I would like to know how they made fine tune?

Did you use the huggingface trl GRPO libraries?

Could you provide the libraries for the training?

thank you so much

Open Thoughts org

We used llama factory. Code coming soon in https://github.com/open-thoughts/open-thoughts

Sign up or log in to comment