Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
Spaces:
yhavinga
/
dutch-tokenizer-arena
Like
8
Running
App
Files
Files
Community
1
Fetching metadata from the HF Docker repository...
7d2062e
dutch-tokenizer-arena
/
tokenizer
6.03 kB
Ctrl+K
Ctrl+K
3 contributors
History:
7 commits
xu-song
add compress rate
814ee6b
over 2 years ago
chinese_sptokenizer_patch.py
Safe
27 Bytes
add compress rate
over 2 years ago
sptokenizer_patch.py
Safe
2.82 kB
add compress rate
over 2 years ago
tiktoken_patch.py
Safe
2.97 kB
add compress rate
over 2 years ago
tokenizer_patcher.py
Safe
211 Bytes
add compress rate
over 2 years ago
