Delete added_tokens.json as config.json already have pad token
Browse filesMore details can see https://github.com/huggingface/transformers/pull/37444#discussion_r2043927196
- added_tokens.json +0 -3
added_tokens.json
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
{
|
| 2 |
-
"<pad>": 100352
|
| 3 |
-
}
|
|
|
|
|
|
|
|
|
|
|
|