Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference Providers
Select all
Cerebras
Cohere
Nebius AI Studio
Together AI
Fireworks
SambaNova
Nscale
Novita
Replicate
Hyperbolic
fal
HF Inference API
Misc
Reset Misc
tokenizer
Inference Endpoints
text-generation-inference
Misc with no match
Eval Results
Merge
4-bit precision
custom_code
8-bit precision
text-embeddings-inference
Carbon Emissions
Mixture of Experts
Apply filters
Models
65
Full-text search
Edit filters
Sort: Trending
Active filters:
tokenizer
Clear all
gpwr/bark-it-tokenizer
Updated
Nov 9, 2024
charanhu/kannada-tokenizer
Text Generation
•
Updated
Nov 12, 2024
•
2
GlowCheese/minBERT
Text Classification
•
Updated
Dec 4, 2024
•
1
AhmetSemih/tr_tokenizer
Updated
Dec 26, 2024
aliarda/turkish_tokenizer
Updated
Dec 3, 2024
•
1
aliarda/turkish_tokenizer_256k
Updated
Dec 4, 2024
•
1
tejagowda/t5-hebrew-translation
Text Classification
•
Updated
Dec 7, 2024
•
38
aloobun/IN-Llama-3-Tokenizer
Updated
Mar 7
clearloop/tokenizer
Updated
Jan 7
Saiteja/telugu-bpe
Updated
Jan 5
•
3
aayushraina/hindi-bpe-tokenizer
Text2Text Generation
•
Updated
Jan 11
aayushraina/bpe-hindi
Text2Text Generation
•
Updated
Jan 11
physical-intelligence/fast
Robotics
•
Updated
Jan 16
•
111
InterwebAlchemy/PGNTokenizer
Updated
Feb 11
sachin6624/sachin-gpt2-tokenizer
Updated
Feb 3
•
1
Ornaments/72k-Bilingual-BBPE-TK-SPM-Identity
Updated
Feb 18
Ornaments/72k-TK-BBPE-HF
Updated
Feb 18
savath/laonlp-enhanced
Updated
Feb 21
suffolk-design/uniformat-longformer-v1
Text Classification
•
Updated
Feb 21
•
8
mishmish66/throwing_fast
Robotics
•
Updated
Feb 28
Adiii143/code-search-net-tokenizer
Updated
Mar 12
maverickweyunga/Sarufi
Updated
Apr 5
mishmish66/trying-fast
Robotics
•
Updated
Apr 22
deshanksuman/romanized-sinhala-tokenizer
Updated
Apr 22
Namuun123/mn_sentencepiece_tokenizer
Updated
Apr 25
luispintoc/MoleBERT-Tokenizer-NbTMC_scratch_150k_20ep
Updated
May 9
•
12
luispintoc/MoleBERT-Tokenizer-NbTMC_scratch_400k_30ep
Updated
May 9
•
128
ArabovMK/tajik-tokenizers-v1
Updated
about 1 month ago
nsslq/segmo
Updated
25 days ago
Hailay/geez-tokenizer
Token Classification
•
Updated
24 days ago
Previous
1
2
3
Next