Hugging Face's logo

mradermacher
/
Mistral-2x24B-MOE-Power-Devstral-Magistral-Reasoning-Ultimate-44B-GGUF

Transformers
GGUF
Merge
programming
code generation
Codestral
code
Mixture of Experts
coding
coder
chat
mistral
mixtral
mixture of experts
mistral moe
2X24B
reasoning
thinking
Devstral
Magistral
conversational
Model card Files
xet
Community
mradermacher commited on
Commit
4216bbc
·
verified ·
1 Parent(s): d2e23a9

auto-patch README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -1
README.md CHANGED
@@ -63,7 +63,7 @@ static quants of https://huggingface.co/DavidAU/Mistral-2x24B-MOE-Power-Devstral
63
 
64
  ***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Mistral-2x24B-MOE-Power-Devstral-Magistral-Reasoning-Ultimate-44B-GGUF).***
65
 
66
- weighted/imatrix quants seem not to be available (by me) at this time. If they do not show up a week or so after the static ones, I have probably not planned for them. Feel free to request them by opening a Community Discussion.
67
  ## Usage
68
 
69
  If you are unsure how to use GGUF files, refer to one of [TheBloke's
@@ -80,8 +80,11 @@ more details, including on how to concatenate multi-part files.
80
  | [GGUF](https://huggingface.co/mradermacher/Mistral-2x24B-MOE-Power-Devstral-Magistral-Reasoning-Ultimate-44B-GGUF/resolve/main/Mistral-2x24B-MOE-Power-Devstral-Magistral-Reasoning-Ultimate-44B.Q3_K_S.gguf) | Q3_K_S | 19.2 | |
81
  | [GGUF](https://huggingface.co/mradermacher/Mistral-2x24B-MOE-Power-Devstral-Magistral-Reasoning-Ultimate-44B-GGUF/resolve/main/Mistral-2x24B-MOE-Power-Devstral-Magistral-Reasoning-Ultimate-44B.Q3_K_M.gguf) | Q3_K_M | 21.2 | lower quality |
82
  | [GGUF](https://huggingface.co/mradermacher/Mistral-2x24B-MOE-Power-Devstral-Magistral-Reasoning-Ultimate-44B-GGUF/resolve/main/Mistral-2x24B-MOE-Power-Devstral-Magistral-Reasoning-Ultimate-44B.Q3_K_L.gguf) | Q3_K_L | 22.9 | |
 
83
  | [GGUF](https://huggingface.co/mradermacher/Mistral-2x24B-MOE-Power-Devstral-Magistral-Reasoning-Ultimate-44B-GGUF/resolve/main/Mistral-2x24B-MOE-Power-Devstral-Magistral-Reasoning-Ultimate-44B.Q4_K_S.gguf) | Q4_K_S | 25.1 | fast, recommended |
84
  | [GGUF](https://huggingface.co/mradermacher/Mistral-2x24B-MOE-Power-Devstral-Magistral-Reasoning-Ultimate-44B-GGUF/resolve/main/Mistral-2x24B-MOE-Power-Devstral-Magistral-Reasoning-Ultimate-44B.Q4_K_M.gguf) | Q4_K_M | 26.6 | fast, recommended |
 
 
85
  | [GGUF](https://huggingface.co/mradermacher/Mistral-2x24B-MOE-Power-Devstral-Magistral-Reasoning-Ultimate-44B-GGUF/resolve/main/Mistral-2x24B-MOE-Power-Devstral-Magistral-Reasoning-Ultimate-44B.Q6_K.gguf) | Q6_K | 36.0 | very good quality |
86
  | [GGUF](https://huggingface.co/mradermacher/Mistral-2x24B-MOE-Power-Devstral-Magistral-Reasoning-Ultimate-44B-GGUF/resolve/main/Mistral-2x24B-MOE-Power-Devstral-Magistral-Reasoning-Ultimate-44B.Q8_0.gguf) | Q8_0 | 46.5 | fast, best quality |
87
 
 
63
 
64
  ***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Mistral-2x24B-MOE-Power-Devstral-Magistral-Reasoning-Ultimate-44B-GGUF).***
65
 
66
+ weighted/imatrix quants are available at https://huggingface.co/mradermacher/Mistral-2x24B-MOE-Power-Devstral-Magistral-Reasoning-Ultimate-44B-i1-GGUF
67
  ## Usage
68
 
69
  If you are unsure how to use GGUF files, refer to one of [TheBloke's
 
80
  | [GGUF](https://huggingface.co/mradermacher/Mistral-2x24B-MOE-Power-Devstral-Magistral-Reasoning-Ultimate-44B-GGUF/resolve/main/Mistral-2x24B-MOE-Power-Devstral-Magistral-Reasoning-Ultimate-44B.Q3_K_S.gguf) | Q3_K_S | 19.2 | |
81
  | [GGUF](https://huggingface.co/mradermacher/Mistral-2x24B-MOE-Power-Devstral-Magistral-Reasoning-Ultimate-44B-GGUF/resolve/main/Mistral-2x24B-MOE-Power-Devstral-Magistral-Reasoning-Ultimate-44B.Q3_K_M.gguf) | Q3_K_M | 21.2 | lower quality |
82
  | [GGUF](https://huggingface.co/mradermacher/Mistral-2x24B-MOE-Power-Devstral-Magistral-Reasoning-Ultimate-44B-GGUF/resolve/main/Mistral-2x24B-MOE-Power-Devstral-Magistral-Reasoning-Ultimate-44B.Q3_K_L.gguf) | Q3_K_L | 22.9 | |
83
+ | [GGUF](https://huggingface.co/mradermacher/Mistral-2x24B-MOE-Power-Devstral-Magistral-Reasoning-Ultimate-44B-GGUF/resolve/main/Mistral-2x24B-MOE-Power-Devstral-Magistral-Reasoning-Ultimate-44B.IQ4_XS.gguf) | IQ4_XS | 23.8 | |
84
  | [GGUF](https://huggingface.co/mradermacher/Mistral-2x24B-MOE-Power-Devstral-Magistral-Reasoning-Ultimate-44B-GGUF/resolve/main/Mistral-2x24B-MOE-Power-Devstral-Magistral-Reasoning-Ultimate-44B.Q4_K_S.gguf) | Q4_K_S | 25.1 | fast, recommended |
85
  | [GGUF](https://huggingface.co/mradermacher/Mistral-2x24B-MOE-Power-Devstral-Magistral-Reasoning-Ultimate-44B-GGUF/resolve/main/Mistral-2x24B-MOE-Power-Devstral-Magistral-Reasoning-Ultimate-44B.Q4_K_M.gguf) | Q4_K_M | 26.6 | fast, recommended |
86
+ | [GGUF](https://huggingface.co/mradermacher/Mistral-2x24B-MOE-Power-Devstral-Magistral-Reasoning-Ultimate-44B-GGUF/resolve/main/Mistral-2x24B-MOE-Power-Devstral-Magistral-Reasoning-Ultimate-44B.Q5_K_S.gguf) | Q5_K_S | 30.2 | |
87
+ | [GGUF](https://huggingface.co/mradermacher/Mistral-2x24B-MOE-Power-Devstral-Magistral-Reasoning-Ultimate-44B-GGUF/resolve/main/Mistral-2x24B-MOE-Power-Devstral-Magistral-Reasoning-Ultimate-44B.Q5_K_M.gguf) | Q5_K_M | 31.2 | |
88
  | [GGUF](https://huggingface.co/mradermacher/Mistral-2x24B-MOE-Power-Devstral-Magistral-Reasoning-Ultimate-44B-GGUF/resolve/main/Mistral-2x24B-MOE-Power-Devstral-Magistral-Reasoning-Ultimate-44B.Q6_K.gguf) | Q6_K | 36.0 | very good quality |
89
  | [GGUF](https://huggingface.co/mradermacher/Mistral-2x24B-MOE-Power-Devstral-Magistral-Reasoning-Ultimate-44B-GGUF/resolve/main/Mistral-2x24B-MOE-Power-Devstral-Magistral-Reasoning-Ultimate-44B.Q8_0.gguf) | Q8_0 | 46.5 | fast, best quality |
90