---
license: apache-2.0
model_name: Mistral-Small-3.1-24B-Instruct-2503
base_model: mistralai/Mistral-Small-3.1-24B-Instruct-2503
model_creator: mistralai
quantized_by: Second State Inc.
inference: false
language:
- en
- fr
- de
- es
- pt
- it
- ja
- ko
- ru
- zh
- ar
- fa
- id
- ms
- ne
- pl
- ro
- sr
- sv
- tr
- uk
- vi
- hi
- bn
tags:
- transformers
pipeline_tag: image-text-to-text
---

# Mistral-Small-3.1-24B-Instruct-2503-GGUF

## Original Model

[mistralai/Mistral-Small-3.1-24B-Instruct-2503](https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503)

## Run with Gaianet

**Prompt template:**

prompt template: 

  - Chat: `mistral-small-chat`
  <!-- - Chat + Tool Use: `mistral-small-tool` -->

**Context size:**

chat_ctx_size: `32000`

**Run with GaiaNet:**

- Quick start: https://docs.gaianet.ai/node-guide/quick-start

- Customize your node: https://docs.gaianet.ai/node-guide/customize

*Quantized with llama.cpp b4944*