QuixiAI/QuixiGR00T-N1.5-3B-Zero
3B
โข
Updated
โข
10
โข
10
Aton Mountlook
AtonMountlook
AI & ML interests
None yet
Recent Activity
liked
a model
2 months ago
QuixiAI/QuixiGR00T-N1.5-3B-Zero
liked
a model
6 months ago
bartowski/Nitral-AI_Captain-Eris_Violet-GRPO-v0.420-GGUF
Organizations
None yet
liked
a
model
2 months ago
reacted to
Undi95's
post with ๐
6 months ago
Post
10444
Hi there!
If you want to create your own thinking model or do a better MistralThinker, I just uploaded my entire dataset made on Deepseek R1 and the axolotl config. (well I made them public)
Axolotl config : Undi95/MistralThinker-v1.1
The dataset : Undi95/R1-RP-ShareGPT3
You can also read all I did on those two discord screenshot from two days ago, I'm a little lazy to rewrite all kek.
Hope you will use them!
If you want to create your own thinking model or do a better MistralThinker, I just uploaded my entire dataset made on Deepseek R1 and the axolotl config. (well I made them public)
Axolotl config : Undi95/MistralThinker-v1.1
The dataset : Undi95/R1-RP-ShareGPT3
You can also read all I did on those two discord screenshot from two days ago, I'm a little lazy to rewrite all kek.
Hope you will use them!
- 6 replies
liked
a
model
6 months ago
reacted to
cogwheelhead's
post with ๐
6 months ago
Post
2530
Me and my team have performed an in-depth investigation comparing o1 to R1 (and other reasoning models)
Link: https://toloka.ai/blog/r1-is-not-on-par-with-o1-and-the-difference-is-qualitative-not-quantitative
It started with us evaluating them on our own university-math benchmarks: U-MATH for problem-solving and ฮผ-MATH for judging solution correctness (see the HF leaderboard: toloka/u-math-leaderboard)
tl;dr: R1 sure is amazing, but what we find is that it lags behind in novelty adaptation and reliability:
* performance drops when updating benchmarks with fresh unseen tasks (e.g. AIME 2024 -> 2025)
* R1-o1 gap widens when evaluating niche subdomains (e.g. university-specific math instead of the more common Olympiad-style contests)
* same with going into altogether unconventional domains (e.g. chess) or skills (e.g. judgment instead of problem-solving)
* R1 also runs into failure modes way more often (e.g. making illegal chess moves or falling into endless generation loops)
Our point here is not to bash on DeepSeek โ they've done exceptional work, R1 is a game-changer, and we have no intention to downplay that. R1's release is a perfect opportunity to study where all these models differ and gain understanding on how to move forward from here
Link: https://toloka.ai/blog/r1-is-not-on-par-with-o1-and-the-difference-is-qualitative-not-quantitative
It started with us evaluating them on our own university-math benchmarks: U-MATH for problem-solving and ฮผ-MATH for judging solution correctness (see the HF leaderboard: toloka/u-math-leaderboard)
tl;dr: R1 sure is amazing, but what we find is that it lags behind in novelty adaptation and reliability:
* performance drops when updating benchmarks with fresh unseen tasks (e.g. AIME 2024 -> 2025)
* R1-o1 gap widens when evaluating niche subdomains (e.g. university-specific math instead of the more common Olympiad-style contests)
* same with going into altogether unconventional domains (e.g. chess) or skills (e.g. judgment instead of problem-solving)
* R1 also runs into failure modes way more often (e.g. making illegal chess moves or falling into endless generation loops)
Our point here is not to bash on DeepSeek โ they've done exceptional work, R1 is a game-changer, and we have no intention to downplay that. R1's release is a perfect opportunity to study where all these models differ and gain understanding on how to move forward from here
liked
a
model
6 months ago
liked
2
models
7 months ago
upvoted
a
collection
7 months ago
liked
a
model
8 months ago
liked
a
model
about 1 year ago
upvoted
a
collection
about 1 year ago
reacted to
Undi95's
post with โค๏ธ
about 1 year ago
Post
15473
Hello there,
New model released, my goal was to try finetune on the last Llama-3.1-8B-Instruct but not a small train, I wanted to do something useful.
One of the rare model that I didn't made for RP, or in the goal to uncensor it (but I did anyway kek).
The model was trained on 9M Claude conversations ONLY, giving him another writting style.
Undi95/Meta-Llama-3.1-8B-Claude > OG release fp32, it's the epoch 2
Undi95/Meta-Llama-3.1-8B-Claude-bf16 > Base model resharded in bf16 waiting for available quant without issues
Since it's frustrating to be censored using a local model, orthogonal activation steering was used, trying to force the model to never refuse a prompt.
Undi95/Meta-Llama-3.1-8B-Claude-68fail-3000total > Uncensored model, refuse 68 times on 3000 toxic prompt
Undi95/Meta-Llama-3.1-8B-Claude-39fail-3000total > Uncensored model, refuse 39 times on 3000 toxic prompt
It still refuse some prompt but the majority of them is uncensored. OAS can make a model more dumb or make the base perplexity go higher, so I didn't snipe for 0 refusal.
I don't do non-RP model a lot so any feedback is welcome, I would like to re-use this base for some others future project if needed.
New model released, my goal was to try finetune on the last Llama-3.1-8B-Instruct but not a small train, I wanted to do something useful.
One of the rare model that I didn't made for RP, or in the goal to uncensor it (but I did anyway kek).
The model was trained on 9M Claude conversations ONLY, giving him another writting style.
Undi95/Meta-Llama-3.1-8B-Claude > OG release fp32, it's the epoch 2
Undi95/Meta-Llama-3.1-8B-Claude-bf16 > Base model resharded in bf16 waiting for available quant without issues
Since it's frustrating to be censored using a local model, orthogonal activation steering was used, trying to force the model to never refuse a prompt.
Undi95/Meta-Llama-3.1-8B-Claude-68fail-3000total > Uncensored model, refuse 68 times on 3000 toxic prompt
Undi95/Meta-Llama-3.1-8B-Claude-39fail-3000total > Uncensored model, refuse 39 times on 3000 toxic prompt
It still refuse some prompt but the majority of them is uncensored. OAS can make a model more dumb or make the base perplexity go higher, so I didn't snipe for 0 refusal.
I don't do non-RP model a lot so any feedback is welcome, I would like to re-use this base for some others future project if needed.
-
- 4 replies
liked
2
models
over 1 year ago
reacted to
Undi95's
post with ๐ค
over 1 year ago
Post
16590
Hey everyone,
Just wanted to shout out a massive thank you to all 2000 of you who've followed me on Hugging Face! ๐ It's incredible to have such an awesome crew backing me up as I dive into all these LLM experiments.
Even though not all my models turn out perfect, I've found some real gems and methods along the way ๐. It's like digging for treasure โ sometimes you found nothing, but sometimes you find a pearl, and sometimes you find a new method to try.
Your support and encouragement mean the world to me, and I'm really stoked to keep experimenting and learning. If you told me some years ago I would have so much people following me for what I do, I wouldn't have believed it. Here's to more discoveries and adventures ahead! ๐
Also, big thanks once again, and a huge shoutout to @IkariDev for being there through this journey and supporting me. I'm excited for our future work together and hope we will continue to make people happy! ๐
I want to thank @Gryphe too, since my early work was heavily inspired from MythoMax and the RP/ERP vibe of it. If I'm here today it's probably because of you ๐
I was so close to forget @chargoddard and his amazing tool too! What will we do without mergekit in our life? Thank you! ๐
See y'all at 3k!
Just wanted to shout out a massive thank you to all 2000 of you who've followed me on Hugging Face! ๐ It's incredible to have such an awesome crew backing me up as I dive into all these LLM experiments.
Even though not all my models turn out perfect, I've found some real gems and methods along the way ๐. It's like digging for treasure โ sometimes you found nothing, but sometimes you find a pearl, and sometimes you find a new method to try.
Your support and encouragement mean the world to me, and I'm really stoked to keep experimenting and learning. If you told me some years ago I would have so much people following me for what I do, I wouldn't have believed it. Here's to more discoveries and adventures ahead! ๐
Also, big thanks once again, and a huge shoutout to @IkariDev for being there through this journey and supporting me. I'm excited for our future work together and hope we will continue to make people happy! ๐
I want to thank @Gryphe too, since my early work was heavily inspired from MythoMax and the RP/ERP vibe of it. If I'm here today it's probably because of you ๐
I was so close to forget @chargoddard and his amazing tool too! What will we do without mergekit in our life? Thank you! ๐
See y'all at 3k!
- 5 replies
reacted to
abhishek's
post with ๐ฅ
over 1 year ago
Post
3486
With AutoTrain, you can already finetune the latest llama3 models without writing a single line of code. Here's an example finetune of llama3 8b model: https://huggingface.co/abhishek/autotrain-llama3-no-robots
- 2 replies
reacted to
Undi95's
post with ๐
over 1 year ago
Post
Hey, it took some time but I finally moved out and got internet back, so here I am again!
A lot of things to get updated on, I will try to reply to each of you ASAP.
See you soon!
A lot of things to get updated on, I will try to reply to each of you ASAP.
See you soon!
- 1 reply
reacted to
DmitryRyumin's
post with ๐
over 1 year ago
Post
1618
๐๐ญ๐ New Research Alert! ๐ ๐ญ๐
๐ Title: FlashFace: Human Image Personalization with High-fidelity Identity Preservation ๐
๐ Description: FlashFace is a personalized photo editing tool that focuses on high-fidelity identity preservation and improved compliance through advanced encoding and integration strategies.
๐ฅ Authors: Shilong Zhang, Lianghua Huang, @xichenhku et al.
๐ Paper: FlashFace: Human Image Personalization with High-fidelity Identity Preservation (2403.17008)
๐ Github Page: https://jshilong.github.io/flashface-page
๐ More Papers: more cutting-edge research presented at other conferences in the DmitryRyumin/NewEraAI-Papers curated by @DmitryRyumin
๐ Added to the Avatars Collection: DmitryRyumin/avatars-65df37cdf81fec13d4dbac36
๐ Keywords: #FlashFace #Personalization #HighFidelityIdentity #DeepLearning #Innovation
๐ Title: FlashFace: Human Image Personalization with High-fidelity Identity Preservation ๐
๐ Description: FlashFace is a personalized photo editing tool that focuses on high-fidelity identity preservation and improved compliance through advanced encoding and integration strategies.
๐ฅ Authors: Shilong Zhang, Lianghua Huang, @xichenhku et al.
๐ Paper: FlashFace: Human Image Personalization with High-fidelity Identity Preservation (2403.17008)
๐ Github Page: https://jshilong.github.io/flashface-page
๐ More Papers: more cutting-edge research presented at other conferences in the DmitryRyumin/NewEraAI-Papers curated by @DmitryRyumin
๐ Added to the Avatars Collection: DmitryRyumin/avatars-65df37cdf81fec13d4dbac36
๐ Keywords: #FlashFace #Personalization #HighFidelityIdentity #DeepLearning #Innovation
liked
2
models
over 1 year ago
