Edit model card

You need to agree to share your contact information to access this model

This repository is publicly accessible, but you have to accept the conditions to access its files and content.

This model is exclusively available to Pro subscribers of The Kaitchup. To gain access, subscribe to The Kaitchup Pro, subscribe here. If you are already a Pro subscriber, you will find your access token at the bottom of this page.

Log in or Sign Up to review the conditions and access this model content.

Model Details

This is Qwen/Qwen2.5-7B with a vocabulary reduced to 32k entries using the Minivoc approach. The model has been created, tested, and evaluated by The Kaitchup.

All the details about the Minivoc approach and evaluation in this article: Introducing Minivoc: Faster and Memory-Efficient LLMs Through Vocabulary Reduction

Downloads last month
33
Safetensors
Model size
6.75B params
Tensor type
FP16
·
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Dataset used to train kaitchup/Qwen2.5-7B-Minivoc-32k-v0.1a