A curated collection of machine translation datasets
Pietro Lesci
pietrolesci
AI & ML interests
I like developing and applying causal methods to study the effect of training choices on models’ behaviour, including memorisation, shortcut learning, and tokenisation.
Recent Activity
updated
a dataset
16 days ago
pietrolesci/minipile
updated
a model
18 days ago
pietrolesci/raw_tokenisers
updated
a model
18 days ago
pietrolesci/tokenisers
Organizations
spaces
1
models
14

pietrolesci/raw_tokenisers
Updated

pietrolesci/tokenisers
Updated

pietrolesci/SmolLM-34M-tok32000
Updated

pietrolesci/bert-civilcomments-gradtracking
Updated

pietrolesci/roberta-base_mnli_b9799b8f9b
Updated

pietrolesci/bert-base-uncased_mnli_53fb0761e0
Updated

pietrolesci/bert-tiny_mnli_cdc7ea0d50
Updated

pietrolesci/pythia-14m_2024-01-17T00-07-52
Updated

pietrolesci/gpt2_wikitext-103-raw-v1_L2-H4-E256-C256
Updated

pietrolesci/gpt2_wikitext-2-raw-v1_L2-H4-E256-C256
Updated
datasets
54
pietrolesci/minipile
Viewer
•
Updated
•
6.06M
•
325
pietrolesci/opus-5langs-1M
Viewer
•
Updated
•
5M
•
107
pietrolesci/opus-raw
Viewer
•
Updated
•
4.06B
•
1.14k
pietrolesci/finewebedu-20BT
Updated
•
784
pietrolesci/fineweb-edu-10BT
Updated
•
169
pietrolesci/_minipile
Viewer
•
Updated
•
2.51M
•
582
pietrolesci/pythia-pile-stats
Viewer
•
Updated
•
113M
•
77
pietrolesci/slim-pajama-eval
Viewer
•
Updated
•
1.84M
•
83
•
1
pietrolesci/pile-subset
Updated
•
53
pietrolesci/pile_preshuffled_seeds
Updated
•
49
•
1