Hugging Face's logo

TenzinGayche
/
full_merge_16k

Transformers
Model card Files
xet
Community
TenzinGayche commited on
Commit
aaaf03d
·
verified ·
1 Parent(s): b186f48

Upload tokenizer

Browse files
Files changed (4) hide show
  1. added_tokens.json +0 -0
  2. tokenizer.json +2 -2
  3. tokenizer.model +3 -0
  4. tokenizer_config.json +0 -0
added_tokens.json CHANGED
The diff for this file is too large to render. See raw diff
 
tokenizer.json CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:78419e2e05a031870c1a07690bfc0fd1d62342284d422e9b3f3fea8caf2d465a
3
- size 36491407
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7d36c61b4e8f4f4afe67ce8e51b780d96e81ae8e6158c60f4180f5d81fd2b025
3
+ size 34879423
tokenizer.model ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1299c11d7cf632ef3b4e11937501358ada021bbdf7c47638d13c0ee982f2e79c
3
+ size 4689074
tokenizer_config.json CHANGED
The diff for this file is too large to render. See raw diff