Hugging Face's logo
Negar Foroutan's picture

Negar Foroutan

negar-foroutan
nataliaElv's profile picture 21world's profile picture thomwolf's profile picture
·
http://negar.foroutan.info

AI & ML interests

NLP, Multilingual LLMs, Cross-lingual Transfer

Recent Activity

authored a paper about 13 hours ago
FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language
reacted to thomwolf's post with 👍 7 months ago
We are proud to announce https://huggingface.co/datasets/HuggingFaceFW/fineweb-2: A sparkling update to https://huggingface.co/datasets/HuggingFaceFW/fineweb with 1000s of 🗣️languages. We applied the same data-driven approach that led to SOTA English performance in🍷 FineWeb to thousands of languages. 🥂 FineWeb2 has 8TB of compressed text data and outperforms other multilingual datasets in our experiments. The dataset is released under the permissive 📜 ODC-By 1.0 license, and the 💻 code to reproduce it and our evaluations is public. We will very soon announce a big community project, and are working on a 📝 blogpost walking you through the entire dataset creation process. Stay tuned! In the mean time come ask us question on our chat place: https://huggingface.co/spaces/HuggingFaceFW/discussion H/t @guipenedo @hynky @lvwerra as well as @vsabolcec Bettina Messmer @negar-foroutan and @mjaggi
reacted to thomwolf's post with 🤗 7 months ago
We are proud to announce https://huggingface.co/datasets/HuggingFaceFW/fineweb-2: A sparkling update to https://huggingface.co/datasets/HuggingFaceFW/fineweb with 1000s of 🗣️languages. We applied the same data-driven approach that led to SOTA English performance in🍷 FineWeb to thousands of languages. 🥂 FineWeb2 has 8TB of compressed text data and outperforms other multilingual datasets in our experiments. The dataset is released under the permissive 📜 ODC-By 1.0 license, and the 💻 code to reproduce it and our evaluations is public. We will very soon announce a big community project, and are working on a 📝 blogpost walking you through the entire dataset creation process. Stay tuned! In the mean time come ask us question on our chat place: https://huggingface.co/spaces/HuggingFaceFW/discussion H/t @guipenedo @hynky @lvwerra as well as @vsabolcec Bettina Messmer @negar-foroutan and @mjaggi
View all activity

Organizations

FineData's profile picture mlo-data-cleaning's profile picture HuggingFaceFW-Dev's profile picture BabyLM Challenge's profile picture EPFL NLP Lab's profile picture