dreamerdeo (Longxu Dou)

upvoted a paper 4 days ago

Exploring Multi-Grained Concept Annotations for Multimodal Large Language Models

Paper • 2412.05939 • Published Dec 8, 2024 • 15

upvoted 4 collections about 1 month ago

upvoted a collection about 2 months ago

🔱 Sailor2 Language Models

Collection

Sailing in South-East Asia with Inclusive Multilingual LLMs • 9 items • Updated Dec 3, 2024 • 22

upvoted 2 collections 2 months ago

OpenCoder Model

Collection

OpenCoder Models • 9 items • Updated Nov 19, 2024 • 10

OS-Atlas

Collection

OS-Atlas series models • 7 items • Updated Nov 18, 2024 • 13

upvoted an article 6 months ago

Article

RegMix: Data Mixture as Regression for Language Model Pre-training

By

•

Jul 11, 2024

• 10

upvoted a collection 6 months ago

📈 Scaling Laws with Vocabulary

Collection

Increase your vocabulary size when you scale up your language model • 5 items • Updated Aug 11, 2024 • 6

upvoted a paper 6 months ago

Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies

Paper • 2407.13623 • Published Jul 18, 2024 • 54

upvoted a paper 7 months ago

Bootstrapping Language Models with DPO Implicit Rewards

Paper • 2406.09760 • Published Jun 14, 2024 • 39

upvoted 2 collections 7 months ago

💡 DICE

Collection

Self-alignment with DPO Implicit Rewards • 5 items • Updated Jul 28, 2024 • 9

🧬 RegMix: Data Mixture as Regression

Collection

Automatic data mixture method for large language model pre-training • 10 items • Updated Jul 26, 2024 • 8

upvoted a paper 7 months ago

RegMix: Data Mixture as Regression for Language Model Pre-training

Paper • 2407.01492 • Published Jul 1, 2024 • 36

upvoted 2 collections 8 months ago

Datasets for Pretrained Thai LLM

Collection

List Datasets for pretrained Thai LLM by PyThaiNLP • 23 items • Updated Sep 12, 2024 • 9

Text dataset

Collection

Gather text dataset. • 23 items • Updated Dec 17, 2024 • 1

upvoted an article 9 months ago

Article

Large-scale Near-deduplication Behind BigCode

May 16, 2023

• 20

upvoted a collection 9 months ago

Meta Llama 3

Collection

This collection hosts the transformers and original repos of the Meta Llama 3 and Llama Guard 2 releases • 5 items • Updated Dec 6, 2024 • 703

upvoted a paper 10 months ago

Sailor: Open Language Models for South-East Asia

Paper • 2404.03608 • Published Apr 4, 2024 • 20

Longxu Dou PRO

AI & ML interests

Organizations

dreamerdeo's activity

Exploring Multi-Grained Concept Annotations for Multimodal Large Language Models

Sailor2 Benchmarks

Sailor2 Post-training Datasets

Sailor2 Pre-training Datasets

Sailor2 Models

🔱 Sailor2 Language Models

OpenCoder Model

OS-Atlas

RegMix: Data Mixture as Regression for Language Model Pre-training

📈 Scaling Laws with Vocabulary

Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies

Bootstrapping Language Models with DPO Implicit Rewards

💡 DICE

🧬 RegMix: Data Mixture as Regression

RegMix: Data Mixture as Regression for Language Model Pre-training

Datasets for Pretrained Thai LLM

Text dataset

Large-scale Near-deduplication Behind BigCode

Meta Llama 3

Sailor: Open Language Models for South-East Asia