Lewdiculous/Violet_Magcap-12B-GGUF-IQ-Imatrix

Hello there.

Here I share my personal GGUF-Imatrix quants of Violet_Magcap-12B.

sillytavern, presets, mistral, chatml,
roleplay, conversational, reasoning, smart

"It will help you solve problems. It will also make you question your existence."
"Use wisely—or don't."

Please check out the original model card as well for added context and model information.

Discussions

• General discussion and author feedback.
  Feedback is always welcome for potential issues with quants and as a way to guide the author in the future iterations.
  Your comments for them are appreciated!

SillyTavern

• [SillyTavern Presets]
  Initially recommended master-import presets and an additional quick-replies set.

[Click Here] [Please Read] - Additional setup.

Reasoning Block + Prefix:

ChatML Format:

Mistral Format: