Guilherme Penedo's picture

Guilherme Penedo

guipenedo

·

AI & ML interests

None yet

Recent Activity

updated a dataset 2 minutes ago

HuggingFaceFW/fineweb

updated a dataset 2 minutes ago

HuggingFaceFW/fineweb

updated a dataset 3 minutes ago

HuggingFaceFW/fineweb

View all activity

Articles

FineWeb2-C: Help Build Better Language Models in Your Language

Organizations

guipenedo's activity

upvoted a paper 14 days ago

Towards Best Practices for Open Datasets for LLM Training

Paper • 2501.08365 • Published 16 days ago • 51

upvoted an article about 1 month ago

Article

FineWeb2-C: Help Build Better Language Models in Your Language

By

•

Dec 23, 2024

• 18

upvoted a collection about 2 months ago

🥂 FineWeb2

3 items • Updated Dec 8, 2024 • 12

upvoted a paper 3 months ago

OpenCoder: The Open Cookbook for Top-Tier Code Large Language Models

Paper • 2411.04905 • Published Nov 7, 2024 • 114

upvoted an article 3 months ago

Article

Releasing the largest multilingual open pretraining dataset

By

•

Nov 13, 2024

• 98

upvoted an article 4 months ago

Article

🇨🇿 BenCzechMark - Can your LLM Understand Czech?

Oct 1, 2024

• 19

upvoted a paper 7 months ago

The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale

Paper • 2406.17557 • Published Jun 25, 2024 • 91

upvoted a paper 9 months ago

What matters when building vision-language models?

Paper • 2405.02246 • Published May 3, 2024 • 102

upvoted 2 papers about 1 year ago

Mamba: Linear-Time Sequence Modeling with Selective State Spaces

Paper • 2312.00752 • Published Dec 1, 2023 • 140

The Falcon Series of Open Language Models

Paper • 2311.16867 • Published Nov 28, 2023 • 13

upvoted a paper over 1 year ago

The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Only

Paper • 2306.01116 • Published Jun 1, 2023 • 33