File size: 937 Bytes
4a17492 ed3235e 4a17492 46b2fad f3b5c6c 8f6ece9 d8a0a8f 73769c0 2c908ae 73769c0 ed3235e |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 |
---
license: apache-2.0
tags:
- qwen3
- 256k context
- thinking
- instruct
- reasoning
- Brainstorm20x
- Neo
- Neo Imatrix
base_model:
- Qwen/Qwen3-4B-Thinking-2507
- Qwen/Qwen3-4B-Instruct-2507
---
<h2>Qwen3-4B-Instruct-2507-NEO-Imatrix-PlayGround-GGUF</h2>
16 Neo Imatrix experimental configs (4B and 6B ggufs) for new Qwen 3 4B 2507 Instruct and "Thinking" 2507 too.
All quants work.
This repo is a test bed for each quant/config type, which will be followed by a single repo per winning "configs".
Repo contains a "baseline" also of Instruct and Thinking as a reference - no "NEO" / 20-2 in the filename.
6 Quants at 6B parameters/55 layers/607 tensors (3 Instruct, 3 Thinking) of Brainstorm 20x (denoted by 20-2 in the file name) too.
All quants: 256k context.
Model Sources [read more about model, settings and so...]:
https://huggingface.co/Qwen/Qwen3-4B-Instruct-2507
https://huggingface.co/Qwen/Qwen3-4B-Thinking-2507 |