39 11 85

Pierre-Carl Langlais

Pclanglais

Dorialexander

AI & ML interests

Open data & open LLMs

Recent Activity

updated a dataset 1 day ago

PleIAs/query-datasets

authored a paper 2 days ago

Towards Best Practices for Open Datasets for LLM Training

updated a dataset 5 days ago

PleIAs/RAG-Evals

View all activity

Articles

They Said It Couldn’t Be Done

Dec 5, 2024

• 76

Releasing the largest multilingual open pretraining dataset

Nov 13, 2024

• 98

The case for specialized pre-training: ultra-fast foundation models for dedicated tasks

Aug 4, 2024

• 27

Announcing Finance Commons and the Bad Data Toolbox: Pioneering Open Data and Advanced Document Processing

Jul 19, 2024

• 18

Post-OCR-Correction: 1 billion words dataset of automated OCR correction by LLM

Apr 26, 2024

• 15

Releasing Youtube-Commons: a massive open corpus for conversational and multimodal data

Apr 18, 2024

• 22

Releasing Common Corpus: the largest public domain dataset for training LLMs

Mar 20, 2024

• 18

Organizations

Pclanglais's activity

upvoted a paper about 2 months ago

UnifiedCrawl: Aggregated Common Crawl for Affordable Adaptation of LLMs on Low-Resource Languages

Paper • 2411.14343 • Published Nov 21, 2024 • 7

upvoted an article 2 months ago

Article

Releasing the largest multilingual open pretraining dataset

•

Nov 13, 2024

• 98

upvoted a paper 2 months ago

Toxicity of the Commons: Curating Open-Source Pre-Training Data

Paper • 2410.22587 • Published Oct 29, 2024 • 10

upvoted 2 articles 3 months ago

Article

Detoxifying the Commons

•

Oct 31, 2024

• 6

Article

OCR Processing and Text in Image Analysis with Florence-2-base and Qwen2-VL-2B

•

Oct 18, 2024

• 14

upvoted 2 articles 4 months ago

Article

VLM Art Analysis

•

Oct 4, 2024

• 11

Article

wHy DoNt YoU jUsT uSe ThE lLaMa ToKeNiZeR??

•

Sep 27, 2024

• 38

upvoted 2 articles 5 months ago

Article

SmolLM - blazingly fast and remarkably powerful

Jul 16, 2024

• 298

Article

The case for specialized pre-training: ultra-fast foundation models for dedicated tasks

•

Aug 4, 2024

• 27

upvoted a collection 7 months ago

Common Pile

Collection

Datasets in the Common Pile. • 25 items • Updated Oct 29, 2024 • 4

upvoted a collection 10 months ago

OpenCulture

Collection

A multilingual dataset of public domain books and newspapers. • 27 items • Updated Nov 6, 2024 • 122