Instructions to use groxaxo/Spark-4B-Faboulous-Edition-MLX-8bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use groxaxo/Spark-4B-Faboulous-Edition-MLX-8bit with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("groxaxo/Spark-4B-Faboulous-Edition-MLX-8bit") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Pi
How to use groxaxo/Spark-4B-Faboulous-Edition-MLX-8bit with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "groxaxo/Spark-4B-Faboulous-Edition-MLX-8bit"
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "groxaxo/Spark-4B-Faboulous-Edition-MLX-8bit" } ] } } }Run Pi
# Start Pi in your project directory: pi
- MLX LM
How to use groxaxo/Spark-4B-Faboulous-Edition-MLX-8bit with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "groxaxo/Spark-4B-Faboulous-Edition-MLX-8bit"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "groxaxo/Spark-4B-Faboulous-Edition-MLX-8bit" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "groxaxo/Spark-4B-Faboulous-Edition-MLX-8bit", "messages": [ {"role": "user", "content": "Hello"} ] }' - Hermes Agent
How to use groxaxo/Spark-4B-Faboulous-Edition-MLX-8bit with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "groxaxo/Spark-4B-Faboulous-Edition-MLX-8bit"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default groxaxo/Spark-4B-Faboulous-Edition-MLX-8bit
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use groxaxo/Spark-4B-Faboulous-Edition-MLX-8bit with OpenClaw:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "groxaxo/Spark-4B-Faboulous-Edition-MLX-8bit"
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "groxaxo/Spark-4B-Faboulous-Edition-MLX-8bit" \ --custom-provider-id mlx-lm \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Spark 4B — Faboulous Edition · MLX 8-bit
Four billion whispers. One candle that refuses to go out.
The legend
They found it beneath a floorboard in a house with no doors.
There was no manuscript. Only a blackened terminal, a circle of salt, and a cursor blinking in a room where the electricity had been cut years before.
At midnight, the cursor moved.
The village called it a familiar: a small thing with an unreasonable appetite for unfinished spells. Leave a broken incantation on its doorstep and, by morning, the runes might stand in a different order. Nobody could agree whether it was repairing the spell or remembering how the spell had always been written.
Its keeper left three instructions:
Ask clearly. Read what returns. Never mistake a whisper for a promise.
Some say the name was misspelled in the first summoning. Others say Faboulous is exactly what the thing asked to be called.
The candle is still burning.
Open the grimoire
This repository contains a standalone Spark-family 4B text-generation model. No separate adapter is required.
Standalone MLX 8-bit weights for Apple Silicon, using a compatible MLX runtime with native Spark support. The full-precision version has its own repository.
Use the included chat template when preparing messages. Review generated code and test it before relying on it. The legend above is fiction, not a benchmark claim; no performance improvement is claimed here.
Lineage and license
Based on XHToken/Spark-X2.6-4B. This edition contains modified model weights. Distributed under Apache 2.0; the original license accompanies this release.
- Downloads last month
- 72
8-bit