Swift-1.5-Qwen3.8-Flash-Next Q4_0-Q8_0-out v3 (GGUF)

โš ๏ธ Runtime Compatibility Notice

This is a qwen4exp architecture GGUF (Gated-DeltaNet hybrid + 512-expert routed MoE + MTP). Stock llama.cpp does not support this architecture. Use a qwen4exp-enabled llama.cpp build (e.g. the unslothai/llama.cpp fork with qwen4exp support) with --mtp-draft for speculative decoding.

Overview

Swift 1.5 Flash Miroslav2.0 โ€” the Swift-optimized (UkisAI "Swift" reasoning-token reduction, ~58% fewer reasoning tokens, hesitation-loop elimination) variant of Qwen3.8 Flash Next, quantized for local serving on Apple Silicon.

  • Build: Q4_0 base re-quantized with Q8_0 donor tensors spliced into the output/embedding/residual tensors (-Q8out-v3 pipeline: 575 tensors upgraded to Q8_0 from the full-precision donor shards), imatrix-calibrated (imatrix-bartv6, calibration dataset Qwen3.8-Flash-Next-calibration-v6)
  • Architecture: qwen4exp โ€” 48 layers (GDN recurrent + full attention every 4th), 512 routed experts (10 active), shared expert, hyper-connections, ngram-PLE embedding, built-in MTP heads
  • Context: 262,144 tokens native
  • Shards: 3 (-00001-of-00003.gguf โ€ฆ -00003-of-00003.gguf), 95 GiB total
  • Vision: vision projector tensors included (image-text-to-text capable)

Files

File Size
Swift-Qwen3.8-Flash-Next-Q4_0-Q8out-v3-00001-of-00003.gguf 42.4 GiB
Swift-Qwen3.8-Flash-Next-Q4_0-Q8out-v3-00002-of-00003.gguf 42.8 GiB
Swift-Qwen3.8-Flash-Next-Q4_0-Q8out-v3-00003-of-00003.gguf 10.3 GiB

Download all three shards into the same directory, then load shard 1.

Usage (qwen4exp-enabled llama.cpp)

llama-server -m Swift-Qwen3.8-Flash-Next-Q4_0-Q8out-v3-00001-of-00003.gguf \
  --mmproj mmproj-f16.gguf -ngl 99 -c 262144 --port 8080

Built and benchmarked locally on Apple M5 Pro (64 GB unified memory) with the Slipstream streaming-MoE llama.cpp fork.

Downloads last month
5,859
GGUF
Model size
177B params
Architecture
qwen4exp
Hardware compatibility
Log In to add your hardware

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for nitinpanj/Swift-Qwen3.8-Flash-Next-Q4_0-Q8out-v3-GGUF

Quantized
(65)
this model
Quantizations
1 model