4, 5, and 6 bit quants of nisten/zelensky-78b

use this as a commander model

no speculative decoding support

Downloads last month
257
GGUF
Model size
78B params
Architecture
qwen2

16-bit

Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.

Model tree for nisten/zelensky-78b-gguf

Base model

Qwen/Qwen2.5-72B
Quantized
(3)
this model