Edit Models filters

Models

551

Full-text search

Active filters: bpe

mni-ml/transformer

Text Generation • Updated 11 days ago • 13

espnet/xeus

Automatic Speech Recognition • Updated Jun 17, 2025 • 66 • 147

gsar78/Greek_Tokenizer

Updated Aug 5, 2024 • 1

Acct2325449/asset-keywords-tokenizer

Updated Sep 18, 2024

charanhu/kannada-tokenizer

Text Generation • Updated Nov 12, 2024 • 2

aloobun/IN-Llama-3-Tokenizer

Updated Mar 7, 2025

Saiteja/telugu-bpe

Updated Jan 5, 2025 • 5

aayushraina/hindi-bpe-tokenizer

Text Generation • Updated Jan 11, 2025

aayushraina/bpe-hindi

Text Generation • Updated Jan 11, 2025

prithivMLmods/Bpe-vocab-n-OCR

Image-to-Text • Updated May 3, 2025 • 13 • 4

mradermacher/Tokenized-OCR-GGUF

2B • Updated Jul 31, 2025 • 94 • 1

mradermacher/Tokenized-OCR-i1-GGUF

2B • Updated Jul 11, 2025 • 98

muzaffercky/kurdish-kurmanji-tokenizer

Updated Jun 30, 2025 • 1

mradermacher/Bpe-vocab-n-OCR-GGUF

2B • Updated Jul 31, 2025 • 126

mradermacher/Bpe-vocab-n-OCR-i1-GGUF

2B • Updated Jul 11, 2025 • 208 • 1

Hailay/geez-tokenizer

Token Classification • Updated Jul 15, 2025

Hengzongshu/Chinse_BBPE_Vocab

Text Classification • Updated Jun 1, 2025

Vipplav/telugu-bpe-23k

Updated Jun 19, 2025

Max1798/my-tokenizer

Updated Jul 17, 2025 • 8

amirhofo/Persian-BPE-Tokenizer

Updated Jul 24, 2025

yakul259/english-bpe-tokenizer-60k

Updated Aug 14, 2025

yakul259/finance-bpe-tokenizer-30k

Updated Aug 15, 2025

toksuite/common-pile-comma-v0.1

Text Generation • 2B • Updated Dec 25, 2025 • 14

toksuite/meta-llama-Llama-3.2-1B

Text Generation • 2B • Updated Dec 25, 2025 • 10

toksuite/microsoft-Phi-3-mini-4k-instruct

Text Generation • 1B • Updated Dec 25, 2025 • 22

toksuite/gpt2

Text Generation • 1B • Updated Dec 25, 2025 • 392

toksuite/bigscience-bloom

Text Generation • 2B • Updated Dec 25, 2025 • 136

MustafaSeker/sugartrq-tokenizer-tr

Updated Sep 2, 2025

toksuite/mistralai-tekken

Text Generation • 2B • Updated Dec 25, 2025 • 12

toksuite/Qwen-Qwen3-8B

Text Generation • 2B • Updated Dec 25, 2025 • 71