Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
dustalov
/
wikitext-wordlevel
like
1
wikitext
English
tokenizers
tokenizer
wordlevel
wikitext
License:
cc-by-sa-3.0
Model card
Files
Files and versions
Community
main
wikitext-wordlevel
1 contributor
History:
10 commits
dustalov
Update README.md
b0f9f16
verified
10 months ago
.gitattributes
Safe
1.52 kB
initial commit
10 months ago
README.md
Safe
1.23 kB
Update README.md
10 months ago
tokenizer.json
Safe
1.81 MB
Rename wikitext-wordlevel.json to tokenizer.json
10 months ago
wikitext-wordlevel.py
Safe
1.38 kB
Upload wikitext-wordlevel.py
10 months ago