---
license: apache-2.0
model_name: Mistral-Small-24B-Instruct-2501
base_model: mistralai/Mistral-Small-24B-Instruct-2501
model_creator: mistralai
quantized_by: Second State Inc.
inference: false
language:
- en
- fr
- de
- es
- it
- pt
- zh
- ja
- ru
- ko
tags:
- transformers
---

# Mistral-Small-24B-Instruct-2501-GGUF

## Original Model

[mistralai/Mistral-Small-24B-Instruct-2501](https://huggingface.co/mistralai/Mistral-Small-24B-Instruct-2501)

## Run with Gaianet

**Prompt template:**

prompt template: `mistral-small-chat`

**Context size:**

chat_ctx_size: `32000`

**Run with GaiaNet:**

- Quick start: https://docs.gaianet.ai/node-guide/quick-start

- Customize your node: https://docs.gaianet.ai/node-guide/customize

*Quantized with llama.cpp b4595*