apepkuss79 commited on
Commit
d52dc33
·
verified ·
1 Parent(s): 2e0995e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +64 -3
README.md CHANGED
@@ -1,3 +1,64 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ model_name: Mistral-Small-3.1-24B-Instruct-2503
4
+ base_model: mistralai/Mistral-Small-3.1-24B-Instruct-2503
5
+ model_creator: mistralai
6
+ quantized_by: Second State Inc.
7
+ inference: false
8
+ language:
9
+ - en
10
+ - fr
11
+ - de
12
+ - es
13
+ - pt
14
+ - it
15
+ - ja
16
+ - ko
17
+ - ru
18
+ - zh
19
+ - ar
20
+ - fa
21
+ - id
22
+ - ms
23
+ - ne
24
+ - pl
25
+ - ro
26
+ - sr
27
+ - sv
28
+ - tr
29
+ - uk
30
+ - vi
31
+ - hi
32
+ - bn
33
+ tags:
34
+ - transformers
35
+ pipeline_tag: image-text-to-text
36
+ ---
37
+
38
+ # Mistral-Small-3.1-24B-Instruct-2503-GGUF
39
+
40
+ ## Original Model
41
+
42
+ [mistralai/Mistral-Small-3.1-24B-Instruct-2503](https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503)
43
+
44
+ ## Run with Gaianet
45
+
46
+ **Prompt template:**
47
+
48
+ prompt template:
49
+
50
+ - Chat: `mistral-small-chat`
51
+ <!-- - Chat + Tool Use: `mistral-small-tool` -->
52
+
53
+ **Context size:**
54
+
55
+ chat_ctx_size: `32000`
56
+
57
+ **Run with GaiaNet:**
58
+
59
+ - Quick start: https://docs.gaianet.ai/node-guide/quick-start
60
+
61
+ - Customize your node: https://docs.gaianet.ai/node-guide/customize
62
+
63
+ *Quantized with llama.cpp b4944*
64
+