Koga Kobayashi
kajyuuen
AI & ML interests
None yet
Organizations
kajyuuen's activity
llama.cppサポート
10
#2 opened 6 months ago
by
cpumaxx
Do not add EOS token when tokenizine by default
3
1
#4 opened 6 months ago
by
p1atdev

add-fast-tokenizer
#1 opened 11 months ago
by
kajyuuen

Not working with latest transformers.
1
#3 opened over 1 year ago
by
kajyuuen

Update distilbert_japanese_tokenizer.py
1
1
#4 opened over 1 year ago
by
liwii
Adding `safetensors` variant of this model
#3 opened over 1 year ago
by
SFconvertbot

Update README.md
1
1
#2 opened over 1 year ago
by
alfredplpl

Allow only unidic_lite
#2 opened about 2 years ago
by
kajyuuen

Improve tokenizers
#1 opened about 2 years ago
by
kajyuuen

Improve tokenizers
#1 opened about 2 years ago
by
kajyuuen
