gpt2-medium-finetuned-infocharya / special_tokens_map.json
AdityaBavadekar's picture
Upload tokenizer
31292d0
raw
history blame
108 Bytes
{
"bos_token": "<[SEQ]>",
"eos_token": "</[SEQ]>",
"pad_token": "<[SEQ]>",
"unk_token": "<[UNK]>"
}