File size: 952 Bytes
d52dc33
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
---
license: apache-2.0
model_name: Mistral-Small-3.1-24B-Instruct-2503
base_model: mistralai/Mistral-Small-3.1-24B-Instruct-2503
model_creator: mistralai
quantized_by: Second State Inc.
inference: false
language:
- en
- fr
- de
- es
- pt
- it
- ja
- ko
- ru
- zh
- ar
- fa
- id
- ms
- ne
- pl
- ro
- sr
- sv
- tr
- uk
- vi
- hi
- bn
tags:
- transformers
pipeline_tag: image-text-to-text
---

# Mistral-Small-3.1-24B-Instruct-2503-GGUF

## Original Model

[mistralai/Mistral-Small-3.1-24B-Instruct-2503](https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503)

## Run with Gaianet

**Prompt template:**

prompt template: 

  - Chat: `mistral-small-chat`
  <!-- - Chat + Tool Use: `mistral-small-tool` -->

**Context size:**

chat_ctx_size: `32000`

**Run with GaiaNet:**

- Quick start: https://docs.gaianet.ai/node-guide/quick-start

- Customize your node: https://docs.gaianet.ai/node-guide/customize

*Quantized with llama.cpp b4944*