archit's picture

archit

archit11

·

archit-spec

AI & ML interests

small language models, looking for work please reachout [email protected]

Recent Activity

upvoted a paper about 12 hours ago

Reinforcement Pre-Training

updated a model 1 day ago

archit11/fuchsia-grpo-finetuned-model

published a model 1 day ago

archit11/fuchsia-grpo-finetuned-model

View all activity

Organizations

archit11's activity

upvoted a paper about 12 hours ago

Reinforcement Pre-Training

Paper • 2506.08007 • Published 1 day ago • 143

upvoted a paper 3 days ago

Beyond the 80/20 Rule: High-Entropy Minority Tokens Drive Effective Reinforcement Learning for LLM Reasoning

Paper • 2506.01939 • Published 8 days ago • 144

upvoted an article 2 months ago

Article

Enabling Long Context Training with Sequence Parallelism in Axolotl

By

and 1 other •

Apr 4

• 8

upvoted an article 3 months ago

Article

SigLIP 2: A better multilingual vision language encoder

By

and 2 others •

Feb 21

• 165

upvoted an article 4 months ago

Article

The case for specialized pre-training: ultra-fast foundation models for dedicated tasks

By

•

Aug 4, 2024

• 30

upvoted 3 collections 4 months ago

Scotch & SOTA 🥃 Pt. 7: Human Feedback Datasets 🫣

The elusive “human” feedback • 1 item • Updated Sep 13, 2023 • 1

Scotch & SOTA 🥃 Pt. 6: Dialogue Tuning Datasets 💬

Conversations, turn-based dialog, and things that can be turned into that. • 4 items • Updated Sep 13, 2023 • 1

Scotch & SOTA 🥃 Pt. 5: Instruction Tuning Datasets 👩‍🏫

Question & answer, task completion, general SFT and otherwise finetuney data. • 7 items • Updated Sep 13, 2023 • 1

upvoted 2 articles 4 months ago

Article

How to deploy and fine-tune DeepSeek models on AWS

By

and 2 others •

Jan 30

• 52

Article

Can we create pedagogically valuable multi-turn synthetic datasets from Cosmopedia?

By

•

May 7, 2024

• 8

upvoted a collection 4 months ago

Deepseek Papers

Deepseek papers collection • 24 items • Updated 2 days ago • 256

upvoted an article 5 months ago

Article

Train 400x faster Static Embedding Models with Sentence Transformers

By

•

Jan 15

• 187

upvoted 4 collections 6 months ago

Reasoning

152 items • Updated 13 days ago • 30

🤖 Agents

21 items • Updated Dec 31, 2024 • 158

Tulu 3 Datasets

All datasets released with Tulu 3 -- state of the art open post-training recipes. • 33 items • Updated Apr 30 • 83

PixMo

A set of vision-language datasets built by Ai2 and used to train the Molmo family of models. Read more at https://molmo.allenai.org/blog • 10 items • Updated Apr 30 • 72

upvoted a paper 7 months ago

Gemma 2: Improving Open Language Models at a Practical Size

Paper • 2408.00118 • Published Jul 31, 2024 • 77

upvoted a collection 7 months ago

VLM Datasets

29 items • Updated Feb 21 • 3

upvoted 2 articles 7 months ago

Article

Low Code Large Language Model Alignment

By

•

Nov 19, 2024

• 13

Article

The Beginners Guide to Cleaning a Dataset

By

•

Nov 18, 2024

• 24