bartowski

/

DeepSeek-R1-GGUF

like 38

Q5-K-M uses 502GB RAM, Q6-K almost 567GB RAM. Tested on CPU, on my ancient 10 years old enterprise Xeon motherboard by Gigabyte with 12 RAM slots, which on used market costs just 100$.
Tested and worked in oobabooga launcher (text generation webui).
LM Studio launcher can't work with such large models still, with any updates, it's hopeless (crashing at loading at 500Gb Ram mark).
My review, unfortunately quantization of this model is not preserving it's strength, it downgraded seriously.
It's very talkative, even too much, that on Q5 quality observed notorius problem of "internal dialogue" with itself (first observed in Falcon 180B quants), non-stop,so R1 need to be precisely tuned in chat parameters (slightly helped frequency penalty 0.05, mirostat 1 kinda works, but i suspect mini_p 0 in deterministic preset is the key).
Q6 quality which is much better in V3 model here not improved it at all.
In test of repairing logical problem in Chuck code both Q5 and Q6 of R1 model failed.
In test or creating Bach melody in Chuck code - Q5 produced many examples but broken code, Q6 also failed (example below).
So, in the end i think V3 model of same size in Q6 is much more better than R1 model in Q6, for now.

R1-Q6-K 567Gb

AI
My apologies for the oversight. The error occurs because the MidiOut class isn't properly capitalized. Here's the corrected version:

// Setup MIDI output
MidiOut mout;
if(!mout.open(0)) me.exit();

// Rest of the code remains the same...

AI
My apologies for the confusion earlier. The error occurs because the MidiOut class name should be capitalized differently. Here's the corrected version:

// Setup MIDI output
MidiOut mout;
if(!mout.open(0)) me.exit();

// Rest of the code...

AI
Let's try a different approach using the ChucK language's built-in MIDI functionality. Here's a corrected and simplified version of the Bach Minuet:

// Set up MIDI output
MidiOut mout;
if(!mout.open(0)) me.exit();