229 25 43

Longxu Dou PRO

dreamerdeo

https://longxudou.github.io/

AI & ML interests

Natural Language Processing

Recent Activity

new activity about 2 hours ago

sailor2/sea-wildbench:[bot] Conversion to Parquet

updated a dataset 2 days ago

sailor2/sea-wildbench

updated a Space 7 days ago

sailor2/README

View all activity

Organizations

dreamerdeo's activity

New activity in sailor2/sea-wildbench about 2 hours ago

[bot] Conversion to Parquet

#2 opened 1 day ago by

parquet-converter

updated a dataset 2 days ago

sailor2/sea-wildbench

Viewer • Updated 2 days ago • 1.02k • 81

updated a Space 7 days ago

README

💻

New activity in sail/Sailor2-20B-SFT about 1 month ago

The number in model.safetensors.index.json is inconsistent with the number of safetensors.

#2 opened about 1 month ago by

aguai

updated a model about 1 month ago

sail/Sailor2-20B-SFT

Text Generation • Updated Feb 24 • 30

updated a collection about 1 month ago

Sailor2 Models

Collection

10 items • Updated Feb 24 • 5

reacted to their post with ➕ about 1 month ago

Post

2802

🚀 Excited to share our technical report on the Southeast Asian multilingual model Sailor2 and its latest updates!

Our 49-page report details Sailor2's development journey, including multilingual data cleaning, small model data mixture simulations, multi-stage continual pre-training, multi-stage post-training, and multi-cultural multi-lingual evaluations. Sailor2 aims to streamline the multilingual model pre-training process efficiently for the community.

🧭 We highlight Sailor2's impressive performance in low-resource language translation scenarios and its cultural understanding advantages in Southeast Asia, promoting practical applications for regional languages.

Model updates include:
💡 More precise outputs: Reduced redundancy in model outputs through refined post-training data and optimization techniques.
🌈 Handling longer texts: Expanded to handle up to 128K context length in Southeast Asian languages through long-text training.
⚡️ Faster inference: Achieved 2.5x faster inference speed with speculative decoding.
🌪️ More model sizes: Introduced new sizes of 3B and 14B through model pruning.

🌟 All models are Apache-licensed for commercial use; development tools (code, resources) are open-source.

📚 Technical report: Sailor2: Sailing in South-East Asia with Inclusive Multilingual LLMs (2502.12982)
🤖️ Models: sail/sailor2-language-models-674d7c9e6b4dbbd9a869906b
💬 Demo: sail/Sailor2-20B-Chat
📣 Sailor2 community: https://huggingface.co/sailor2

New activity in sail/Sailor2-8B-Chat about 1 month ago

Fix formatting

#3 opened about 1 month ago by

nielsr

updated 10 models about 1 month ago