Hugging Face's logo

mradermacher
/
Mistral-Small-3.2-46B-The-Brilliant-Raconteur-Instruct-2506-GGUF

Transformers
GGUF
creative
creative writing
fiction writing
plot generation
sub-plot generation
story generation
scene continue
storytelling
fiction story
science fiction
romance
all genres
story
writing
vivid prose
vivid writing
fiction
roleplaying
float16
rp
mistral3
horror
finetune
thinking
reasoning
coding
general use
all use cases
Not-For-All-Audiences
conversational
Model card Files
xet
Community
mradermacher commited on
Commit
e39b546
·
verified ·
1 Parent(s): a2182aa

auto-patch README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -1
README.md CHANGED
@@ -55,6 +55,10 @@ tags:
55
  - finetune
56
  - thinking
57
  - reasoning
 
 
 
 
58
  ---
59
  ## About
60
 
@@ -66,7 +70,7 @@ tags:
66
  static quants of https://huggingface.co/DavidAU/Mistral-Small-3.2-46B-The-Brilliant-Raconteur-Instruct-2506
67
 
68
  <!-- provided-files -->
69
- weighted/imatrix quants seem not to be available (by me) at this time. If they do not show up a week or so after the static ones, I have probably not planned for them. Feel free to request them by opening a Community Discussion.
70
  ## Usage
71
 
72
  If you are unsure how to use GGUF files, refer to one of [TheBloke's
@@ -83,6 +87,7 @@ more details, including on how to concatenate multi-part files.
83
  | [GGUF](https://huggingface.co/mradermacher/Mistral-Small-3.2-46B-The-Brilliant-Raconteur-Instruct-2506-GGUF/resolve/main/Mistral-Small-3.2-46B-The-Brilliant-Raconteur-Instruct-2506.Q3_K_S.gguf) | Q3_K_S | 19.8 | |
84
  | [GGUF](https://huggingface.co/mradermacher/Mistral-Small-3.2-46B-The-Brilliant-Raconteur-Instruct-2506-GGUF/resolve/main/Mistral-Small-3.2-46B-The-Brilliant-Raconteur-Instruct-2506.Q3_K_M.gguf) | Q3_K_M | 21.9 | lower quality |
85
  | [GGUF](https://huggingface.co/mradermacher/Mistral-Small-3.2-46B-The-Brilliant-Raconteur-Instruct-2506-GGUF/resolve/main/Mistral-Small-3.2-46B-The-Brilliant-Raconteur-Instruct-2506.Q3_K_L.gguf) | Q3_K_L | 23.8 | |
 
86
  | [GGUF](https://huggingface.co/mradermacher/Mistral-Small-3.2-46B-The-Brilliant-Raconteur-Instruct-2506-GGUF/resolve/main/Mistral-Small-3.2-46B-The-Brilliant-Raconteur-Instruct-2506.Q4_K_S.gguf) | Q4_K_S | 25.9 | fast, recommended |
87
  | [GGUF](https://huggingface.co/mradermacher/Mistral-Small-3.2-46B-The-Brilliant-Raconteur-Instruct-2506-GGUF/resolve/main/Mistral-Small-3.2-46B-The-Brilliant-Raconteur-Instruct-2506.Q4_K_M.gguf) | Q4_K_M | 27.5 | fast, recommended |
88
  | [GGUF](https://huggingface.co/mradermacher/Mistral-Small-3.2-46B-The-Brilliant-Raconteur-Instruct-2506-GGUF/resolve/main/Mistral-Small-3.2-46B-The-Brilliant-Raconteur-Instruct-2506.Q5_K_S.gguf) | Q5_K_S | 31.3 | |
 
55
  - finetune
56
  - thinking
57
  - reasoning
58
+ - coding
59
+ - general use
60
+ - all use cases
61
+ - not-for-all-audiences
62
  ---
63
  ## About
64
 
 
70
  static quants of https://huggingface.co/DavidAU/Mistral-Small-3.2-46B-The-Brilliant-Raconteur-Instruct-2506
71
 
72
  <!-- provided-files -->
73
+ weighted/imatrix quants are available at https://huggingface.co/mradermacher/Mistral-Small-3.2-46B-The-Brilliant-Raconteur-Instruct-2506-i1-GGUF
74
  ## Usage
75
 
76
  If you are unsure how to use GGUF files, refer to one of [TheBloke's
 
87
  | [GGUF](https://huggingface.co/mradermacher/Mistral-Small-3.2-46B-The-Brilliant-Raconteur-Instruct-2506-GGUF/resolve/main/Mistral-Small-3.2-46B-The-Brilliant-Raconteur-Instruct-2506.Q3_K_S.gguf) | Q3_K_S | 19.8 | |
88
  | [GGUF](https://huggingface.co/mradermacher/Mistral-Small-3.2-46B-The-Brilliant-Raconteur-Instruct-2506-GGUF/resolve/main/Mistral-Small-3.2-46B-The-Brilliant-Raconteur-Instruct-2506.Q3_K_M.gguf) | Q3_K_M | 21.9 | lower quality |
89
  | [GGUF](https://huggingface.co/mradermacher/Mistral-Small-3.2-46B-The-Brilliant-Raconteur-Instruct-2506-GGUF/resolve/main/Mistral-Small-3.2-46B-The-Brilliant-Raconteur-Instruct-2506.Q3_K_L.gguf) | Q3_K_L | 23.8 | |
90
+ | [GGUF](https://huggingface.co/mradermacher/Mistral-Small-3.2-46B-The-Brilliant-Raconteur-Instruct-2506-GGUF/resolve/main/Mistral-Small-3.2-46B-The-Brilliant-Raconteur-Instruct-2506.IQ4_XS.gguf) | IQ4_XS | 24.6 | |
91
  | [GGUF](https://huggingface.co/mradermacher/Mistral-Small-3.2-46B-The-Brilliant-Raconteur-Instruct-2506-GGUF/resolve/main/Mistral-Small-3.2-46B-The-Brilliant-Raconteur-Instruct-2506.Q4_K_S.gguf) | Q4_K_S | 25.9 | fast, recommended |
92
  | [GGUF](https://huggingface.co/mradermacher/Mistral-Small-3.2-46B-The-Brilliant-Raconteur-Instruct-2506-GGUF/resolve/main/Mistral-Small-3.2-46B-The-Brilliant-Raconteur-Instruct-2506.Q4_K_M.gguf) | Q4_K_M | 27.5 | fast, recommended |
93
  | [GGUF](https://huggingface.co/mradermacher/Mistral-Small-3.2-46B-The-Brilliant-Raconteur-Instruct-2506-GGUF/resolve/main/Mistral-Small-3.2-46B-The-Brilliant-Raconteur-Instruct-2506.Q5_K_S.gguf) | Q5_K_S | 31.3 | |