Gemma 3 27B Tools - 4-bit MLX Quantization
This is a 4-bit MLX quantization of the ZySec-AI/gemma-3-27b-tools model.
Model Description
This repository contains a quantized version of Google's Gemma 3 27B model with tools, optimized for running with Apple's MLX framework. The quantization process reduces the model's size and computational requirements, making it suitable for deployment on devices with limited resources, such as Apple Silicon Macs.
For more details on the original model, please refer to the original model card.
- Downloads last month
- 188
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for BennyDaBall/gemma-3-27b-tools-mlx-4bit
Base model
google/gemma-3-27b-pt
Finetuned
google/gemma-3-27b-it
Finetuned
ZySec-AI/gemma-3-27b-tools