Pile-T5 - a EleutherAI Collection

EleutherAI 's Collections

Pythia Scaling Suite

Quirky Models and Datasets

Pile-T5

Quirky Math (archive)

Pile-T5 T5x Checkpoints

Sparse Autoencoders

Pile-T5

updated Feb 26

T5 trained on the Pile with Llama Tokenizer

EleutherAI/pile-t5-xxl

Text2Text Generation • 11B • Updated Apr 17, 2024 • 143 • 29
EleutherAI/pile-t5-xl

Text2Text Generation • 3B • Updated Apr 17, 2024 • 381 • 12
EleutherAI/pile-t5-large

Text2Text Generation • 0.8B • Updated Apr 17, 2024 • 222 • 16
EleutherAI/pile-t5-base

Text2Text Generation • 0.2B • Updated Apr 17, 2024 • 143 • 20