Is this "broken model"?
#2
by
satos73
- opened
We immediately tried this model. It is very beautiful, but seems to ignore tokens in certain positions.
I checked with toolkit and discovered that the 7, 14, 19, 23, 28, 33, 38, 41, 43, 46, 51, 56, 61, 66, 71, 76th tokens are ignored.
This is consistent with a feature we call "broken model" in the Japanese community. Please see below.(Sorry, It's Japanese blog.)
https://note.com/mayu_hiraizumi/n/n09a7d6ec5678
Q1: Was this feature intended?
Q2: If this feature was unintended, it would be easier to use all TOKEN references depending on how you use it. Since the modification is prohibited by the license, I would like to release a version that sees all tokens.