SpeechQE-TowerInstruct-7B-es2en / added_tokens.json
h-j-han's picture
Upload tokenizer
152cc9c verified
raw
history blame
142 Bytes
{
"<CLS>": 32000,
"<EOD>": 32002,
"<MASK>": 32003,
"<PAD>": 32004,
"<SEP>": 32001,
"<|im_end|>": 32005,
"<|im_start|>": 32006
}