Text Generation
MLX
Safetensors
qwen3_moe
programming
code generation
code
codeqwen
Mixture of Experts
coding
coder
qwen2
chat
qwen
qwen-coder
Qwen3-30B-A3B-Thinking-2507
Qwen3-30B-A3B
mixture of experts
128 experts
8 active experts
256k context
qwen3
finetune
brainstorm 20x
brainstorm
thinking
reasoning
conversational
6-bit
license: apache-2.0 | |
library_name: mlx | |
language: | |
- en | |
- fr | |
- zh | |
- de | |
tags: | |
- programming | |
- code generation | |
- code | |
- codeqwen | |
- moe | |
- coding | |
- coder | |
- qwen2 | |
- chat | |
- qwen | |
- qwen-coder | |
- Qwen3-30B-A3B-Thinking-2507 | |
- Qwen3-30B-A3B | |
- mixture of experts | |
- 128 experts | |
- 8 active experts | |
- 256k context | |
- qwen3 | |
- finetune | |
- brainstorm 20x | |
- brainstorm | |
- thinking | |
- reasoning | |
- qwen3_moe | |
- mlx | |
base_model: DavidAU/Qwen3-42B-A3B-2507-Thinking-TOTAL-RECALL-v2-Medium-MASTER-CODER | |
pipeline_tag: text-generation | |
# Qwen3-42B-A3B-2507-Thinking-TOTAL-RECALL-v2-Medium-MASTER-CODER-q6-hi-mlx | |
This model [Qwen3-42B-A3B-2507-Thinking-TOTAL-RECALL-v2-Medium-MASTER-CODER-q6-hi-mlx](https://huggingface.co/Qwen3-42B-A3B-2507-Thinking-TOTAL-RECALL-v2-Medium-MASTER-CODER-q6-hi-mlx) was | |
converted to MLX format from [DavidAU/Qwen3-42B-A3B-2507-Thinking-TOTAL-RECALL-v2-Medium-MASTER-CODER](https://huggingface.co/DavidAU/Qwen3-42B-A3B-2507-Thinking-TOTAL-RECALL-v2-Medium-MASTER-CODER) | |
using mlx-lm version **0.26.1**. | |
## Use with mlx | |
```bash | |
pip install mlx-lm | |
``` | |
```python | |
from mlx_lm import load, generate | |
model, tokenizer = load("Qwen3-42B-A3B-2507-Thinking-TOTAL-RECALL-v2-Medium-MASTER-CODER-q6-hi-mlx") | |
prompt = "hello" | |
if tokenizer.chat_template is not None: | |
messages = [{"role": "user", "content": prompt}] | |
prompt = tokenizer.apply_chat_template( | |
messages, add_generation_prompt=True | |
) | |
response = generate(model, tokenizer, prompt=prompt, verbose=True) | |
``` | |