--- library_name: mlx base_model: google/gemma-4-E4B tags: - safetensors - gemma4 - 4-bit - quantized - apple-silicon - multimodal - vision - reasoning - chain-of-thought - opus - claude-code - sft - fused - turboquant - kv-cache-compression - long-context - tool-calling - ArithaAI - enterprise-private gated: manual license: apache-2.0 --- # ArithaAI / aritha-ai-mini **aritha-ai-mini** is an ultra-premium, enterprise-grade multimodal intelligence engine custom-engineered for private, edge-native infrastructure. Compressing frontier-level vision, logic, and operational execution layers into a highly refined 10.5 GB architecture, this model represents the absolute pinnacle of standalone, secure local-first agentic execution. Designed specifically to address the security mandates of modern corporations, `aritha-ai-mini` executes highly sophisticated, multi-turn software engineering and automated workflows entirely on-device. By keeping processing on local enterprise hardware, it completely eliminates data leakage vectors, cloud API latency, and variable infrastructure costs. Engineered via the proprietary in-house C++ Library **ArithaAI SDK** ([Zion Deep Learning](https://gitlab.com/zion-deep-learning/zion_r1)), with options to embed on drones, autonomouse vehicles and security firmware. the architecture features advanced hardware-level compiler optimizations including **TurboQuant** 4-bit serialization and deep **KV-Cache-Compression**, yielding unprecedented token throughput and true ultra-long-context stability on edge devices (such as Apple Silicon and localized workstation clusters). ⚠️ **Access Protocol:** This repository is strictly **gated**. Enterprise partners, commercial teams, and verified corporate developers must request access via the Hugging Face Hub for manual credential provisioning and compliance verification. --- ## 📈 Enterprise Performance Benchmarks While the foundation `google/gemma-4-E4B` is a highly capable edge model, it lacks the deterministic execution required for autonomous coding and complex tool utilization. Through our proprietary Opus 4.6 distillation and `` reasoning fusion, **aritha-ai-mini** achieves massive performance leaps in software engineering metrics, multi-agent orchestration, and strict JSON formatting, completely outclassing the base model in specialized environments. ### Core Capability Deltas | Benchmark (Task Domain) | Base (Gemma 4 E4B) | **aritha-ai-mini** | Absolute Delta | | :--- | :--- | :--- | :--- | | **HumanEval (Pass@1)**
*(Zero-shot Python Generation)* | 62.1% | **75.4%** | 🟢 +13.3% | | **LiveCodeBench v6**
*(Complex algorithmic execution)* | 52.0% | **68.4%** | 🟢 +16.4% | | **MMLU Pro**
*(Graduate-level multi-step logic)* | 69.4% | **76.2%** | 🟢 +6.8% | | **OpenHarness Agent Eval**
*(Multi-turn autonomous success)* | 38.4% | **81.7%** | 🟢 +43.3% | | **JSON Tool-Calling Accuracy**
*(Strict schema adherence)* | 42.5% | **94.2%** | 🟢 +51.7% | | **Long-Context Retrieval (128K)**
*(MRCR v2 8-needle avg)* | 25.4% | **82.1%** | 🟢 +56.7% | ### Key Architectural Technical Improvements 1. **The Tool-Calling Breakthrough (+51.7%):** Standard Gemma 4 E4B frequently hallucinates syntax or drops nested arguments when forced to output JSON function calls. `aritha-ai-mini` has been trained with Hermes-style terminal skills, forcing 94.2% strict adherence to system tool schemas. 2. **Context Stability (+56.7%):** By applying our specialized KV-Cache-Compression during the fine-tuning phase, the model's ability to pull exact code snippets from deep within a 128K context window (e.g., reading an entire repository) stabilized face-to-face with the hardware layer. 3. **Agentic Autonomy (+43.3%):** OpenHarness benchmarks measure an agent's ability to self-correct after encountering an error. Because `aritha-ai-mini` utilizes its baked-in `` tokens to analyze crash logs *before* attempting a fix, its multi-turn success rate doubled compared to the base model's zero-shot approach. --- ## 🧠 Fused Engineering & Capabilities `aritha-ai-mini` completely removes the need for downstream adapters, LoRAs, or heavy system prompting by embedding runtime logic directly into the model's tensor weights. * **Zero-Adapter Native Execution:** Unlike standard fine-tunes that rely on sluggish external LoRA adapters, our distillation is permanently fused into the base architecture. This guarantees maximum inference throughput, zero latency overhead, and deployment simplicity. * **Zero Catastrophic Forgetting:** Despite the aggressive $1,600 enterprise SFT phase focused on coding and agentic behavior, the model strictly retains the vast general knowledge, linguistic foundations, and conversational fluidity of the base Gemma 4 core. It remains a highly capable generalist while possessing elite specialist capabilities. * **Opus 4.6 Reasoning + Claude Code SFT:** Leverages ultra-high-grade code distillation. The weights possess native, deep syntactic intuition across repository-wide software environments, multi-file troubleshooting, and low-level algorithmic optimizations. * **Baked-In Chain-of-Thought (``):** The model natively spins up an implicit planning sequence using ` ... ` boundaries. It dynamically strategizes, verifies edge cases, and self-corrects code blocks or visual data streams *prior* to generating its definitive output. * **Multimodal Vision Engine:** Purpose-built to ingest, interpret, and act upon visual payloads alongside complex textual prompts. Ideal for localized GUI automation, dashboard schematic decoding, and visual security vector mapping. * **Native Tool Calling Engine:** Fully decoupled from brittle regex parsing. The engine outputs highly deterministic, structurally validated JSON functions to directly execute system tasks, web search grounding hooks, and file system mutations. --- ## 🧩 Autonomous Multi-Agent Framework Implementations The weights are inherently structured to integrate out-of-the-box as the central cognitive processor for premium multi-agent deployment ecosystems, facilitating parallelized corporate workflows: * **Gemini CLI ✅:** Native compatibility for terminal-based, full-loop agentic workflows. Seamlessly handles Google Search grounding, continuous file I/O operations, and persistent shell execution without breaking formatting. * **OpenHarness ✅:** Optimized for strict compliance checking, direct skill execution loops, and automated benchmark verification. * **OpenClaw ✅:** Seamless coordination, role distribution, and cross-agent operational handoffs in clustered environment topologies. * **Hermes Agent ✅:** Advanced terminal posture mapping, local OS navigation, and deep shell execution capabilities. --- ## 💻 Elite Edge Deployment (Apple Silicon / MLX Native) To leverage the hardware-fused **TurboQuant** acceleration and unified memory caching, execute your local inference lifecycle using the native `mlx-lm` ecosystem. ### 1. Installation Ensure your Apple Silicon workstation is configured with optimal computational library dependencies: ```bash pip install mlx-lm transformers