sail
/

scaling-with-vocab-trained-tokenizers

Model card Files Files and versions

scaling-with-vocab-trained-tokenizers / hf_slimpajama-6B-24576-BPE

Ctrl+K

Ctrl+K

1 contributor

History: 1 commit

tcftrees's picture

Upload folder using huggingface_hub

bdb9681 verified about 1 year ago

special_tokens_map.json

411 Bytes

Upload folder using huggingface_hub about 1 year ago
tokenizer.model

641 kB
xet

Upload folder using huggingface_hub about 1 year ago
tokenizer_config.json

746 Bytes

Upload folder using huggingface_hub about 1 year ago