Updating tokenizer_config.json for vLLM

by RayHuang1991 - opened 4 days ago

RayHuang1991

4 days ago

Dear JWMD,
Thanks for your effort to provide the 8 bit version. I noticed that you post a newer version of tokenizer_config.json in the deepcogito/cogito-v1-preview-qwen-32B. I replaced with your version, it works under vLLM! I just want to leave a message for you if you have a time to update the tokenizer_config.json.

JWMD

Owner 4 days ago

Thanks for the reminder! It should work with any model that you can replace the config.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment