tokenizer_manifest.json · kunjcr2/GatorGPT2 at main

GatorGPT2 / tokenizer_manifest.json

kunjcr2's picture

🚀 Push GatorGPT2 with custom config, model, tokenizer manifest

d711d91 verified 28 days ago

history blame contribute delete

54 Bytes

	{
	"library": "tiktoken",
	"encoding": "p50k_base"
	}