GPT-Kalki / added_tokens.json
tsaditya's picture
Upload tokenizer
56794a5
{
"<|endoftext|>": 50266,
"<|pad|>": 50267,
"<|startoftext|>": 50265
}