ChatNT / bio_tokenizer /special_tokens_map.json
Yanisadel's picture
Rename special_tokens_map.json to bio_tokenizer/special_tokens_map.json
f3b2d0c
raw
history blame
101 Bytes
{
"cls_token": "<cls>",
"mask_token": "<mask>",
"pad_token": "<pad>",
"unk_token": "<unk>"
}