About:

Tuned from Qwen2.5 coder for coding tasks

Special thanks to the folks at Zed Industries for fine-tuning this version of Qwen2.5-Coder-7B. More information about the model can be found here:

https://huggingface.co/zed-industries/zeta (Base Model)

https://huggingface.co/lmstudio-community/zeta-GGUF (GGUF Version)

  • Converted it to MLX format (using mlx-lm version 0.21.4.) for better performance on Apple Silicon Macs (M1,M2,M3,M4 Chips).
  • If you are looking for a smaller (quantized) mlx model, see the models below.

Other Types:

AlejandroOlmedo/zeta-mlx

The Model AlejandroOlmedo/zeta-mlx was converted to MLX format from zed-industries/zeta using mlx-lm version 0.21.4.

Use with mlx

pip install mlx-lm
from mlx_lm import load, generate

model, tokenizer = load("AlejandroOlmedo/zeta-mlx")

prompt = "hello"

if tokenizer.chat_template is not None:
    messages = [{"role": "user", "content": prompt}]
    prompt = tokenizer.apply_chat_template(
        messages, add_generation_prompt=True
    )

response = generate(model, tokenizer, prompt=prompt, verbose=True)
Downloads last month
6
Safetensors
Model size
7.62B params
Tensor type
F16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for AlejandroOlmedo/zeta-mlx

Finetuned
(5)
this model

Dataset used to train AlejandroOlmedo/zeta-mlx