Hugging Face's logo
ChuGyouk's picture
6 15 167

ChuGyouk PRO

ChuGyouk
hyungyongkim14's profile picture junyeong-nero's profile picture ltim's profile picture
Β·
https://gyoukchu.vercel.app/

AI & ML interests

Interested in how to escape from GPU poor

Recent Activity

liked a model about 3 hours ago
perplexity-ai/r1-1776
liked a dataset about 3 hours ago
facebook/natural_reasoning
liked a model about 3 hours ago
Qwen/Qwen2.5-VL-7B-Instruct
View all activity

Organizations

None yet

ChuGyouk's activity

liked a model about 3 hours ago
liked a dataset about 3 hours ago
liked 2 models about 3 hours ago
upvoted a paper about 3 hours ago
liked a dataset 3 days ago
liked a dataset 4 days ago
liked a model 4 days ago
liked a dataset 10 days ago
reacted to s-emanuilov's post with πŸ”₯ 10 days ago
view post
Post
5141
Tutorial πŸ’₯ Training a non-English reasoning model with GRPO and Unsloth

I wanted to share my experiment with training reasoning models in languages other than English/Chinese.

Using Llama 3.1 8B as base, GRPO trainer from trl, and Unsloth optimizations, I got a working prototype in Bulgarian after ~5 hours on an L40S GPU. The approach should work for any language where the base model has some pre-training coverage.

Full code and tutorial here: https://unfoldai.com/reasoning-in-a-non-english-language/

The model itself: s-emanuilov/LLMBG-Llama-3.1-8B-BG-Reasoning-v0.1

I hope this helps anyone looking to build reasoning models in their language.
Β·
liked 2 datasets 10 days ago
updated a dataset 11 days ago
published a dataset 11 days ago
upvoted a collection 11 days ago
liked 3 datasets 11 days ago
liked a dataset 14 days ago
liked a model 21 days ago