Upload tokenizer file tiktoken--gpt-4o_info.json - Upload model files
Browse files- tokenizer_config.json +1 -0
tokenizer_config.json
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"data": {"tokenizer": {"name": "tiktoken", "path": "gpt-4o"}}}
|