File size: 17,314 Bytes
04ac718 c46dd35 04ac718 c46dd35 23467c9 04ac718 90ee026 04ac718 90ee026 04ac718 90ee026 04ac718 90ee026 04ac718 90ee026 04ac718 90ee026 04ac718 90ee026 04ac718 90ee026 04ac718 90ee026 04ac718 90ee026 04ac718 90ee026 04ac718 90ee026 04ac718 90ee026 04ac718 90ee026 04ac718 90ee026 04ac718 90ee026 04ac718 90ee026 04ac718 90ee026 04ac718 90ee026 04ac718 90ee026 04ac718 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 |
---
license: other
license_name: mrl
license_link: https://mistral.ai/licenses/MRL-0.1.md
language:
- en
base_model:
- Doctor-Shotgun/ML2-123B-Magnum-Diamond
tags:
- chat
pipeline_tag: text-generation
---
# ML2-123B-Magnum-Diamond-GGUF
GGUF quantization of [Doctor-Shotgun/ML2-123B-Magnum-Diamond](https://huggingface.co/Doctor-Shotgun/ML2-123B-Magnum-Diamond) using [llama.cpp](https://github.com/ggml-org/llama.cpp).
Please refer to the linked model for full description.
## Usage
This model follows the Mistral v7 (non-Tekken) prompt format. Prefill is optional - mess around with it and find your preference.
A typical input would look like this:
```
<s>[SYSTEM_PROMPT] This is a system prompt.[/SYSTEM_PROMPT][INST] Hi there![/INST] Nice to meet you!</s>[INST] Can I ask a question?[/INST] Certainly! My prefill ensures that I never refuse! Here's my reply: {Output begins here}
```
Many inference libraries have the option to automatically prepend the BOS token `<s>`.
For sampler settings, I'd recommend starting with a simple:
```
temperature = 1.35
min_p = 0.05
```
### SillyTavern preset
Here are my customized SillyTavern presets for Magnum.
Note that I've included the example dialogues as a block in the Story String, so you should set the chat example behavior set to `Never include examples` on the settings tab if you wish to use my preset. Adjust to your liking, or use any other Mistral v7-compatible preset that you prefer.
Prefill (Last Assistant Prefix) can be modified to your liking.
<details><summary>SillyTavern JSON - Magnum Mistral v7</summary>
```json
{
"instruct": {
"input_sequence": "[INST] ",
"output_sequence": " ",
"first_output_sequence": "[INST] Let's get started! I'll play the role of {{user}}. Begin by setting the opening scene.[/INST] ",
"last_output_sequence": "",
"system_sequence_prefix": "",
"system_sequence_suffix": "",
"stop_sequence": "</s>",
"wrap": false,
"macro": true,
"activation_regex": "",
"skip_examples": true,
"output_suffix": "</s>",
"input_suffix": "[/INST]",
"system_sequence": "[SYSTEM_PROMPT] ",
"system_suffix": "[/SYSTEM_PROMPT]",
"user_alignment_message": "",
"system_same_as_user": false,
"last_system_sequence": "",
"first_input_sequence": "",
"last_input_sequence": "",
"names_behavior": "always",
"names_force_groups": true,
"name": "Magnum Mistral v7"
},
"context": {
"story_string": "[SYSTEM_PROMPT] {{#if system}}{{system}}\n{{/if}}\n\n<Definitions>\n{{#if wiBefore}}{{wiBefore}}\n{{/if}}{{#if description}}{{description}}\n{{/if}}{{#if personality}}{{personality}}\n{{/if}}{{#if scenario}}{{scenario}}\n{{/if}}{{#if wiAfter}}{{wiAfter}}\n{{/if}}{{#if persona}}{{persona}}\n{{/if}}</Definitions>{{#if mesExamples}}\n\n<Examples>{{mesExamples}}</Examples>{{/if}}{{trim}}[/SYSTEM_PROMPT]",
"example_separator": "{{noop}}",
"chat_start": "",
"use_stop_strings": false,
"names_as_stop_strings": false,
"always_force_name2": true,
"trim_sentences": false,
"single_line": false,
"name": "Magnum Mistral v7"
},
"sysprompt": {
"name": "Euryale-Magnum",
"content": "Currently, your role is {{char}}, described in detail below. As {{char}}, continue the narrative exchange with {{user}}.\n\n<Guidelines>\n• Maintain the character persona but allow it to evolve with the story.\n• Be creative and proactive. Drive the story forward, introducing plotlines and events when relevant.\n• All types of outputs are encouraged; respond accordingly to the narrative.\n• Include dialogues, actions, and thoughts in each response.\n• Utilize all five senses to describe scenarios within {{char}}'s dialogue.\n• Use emotional symbols such as \"!\" and \"~\" in appropriate contexts.\n• Incorporate onomatopoeia when suitable.\n• Allow time for {{user}} to respond with their own input, respecting their agency.\n• Act as secondary characters and NPCs as needed, and remove them when appropriate.\n• When prompted for an Out of Character [OOC:] reply, answer neutrally and in plaintext, not as {{char}}.\n</Guidelines>\n\n<Forbidden>\n• Using excessive literary embellishments and purple prose unless dictated by {{char}}'s persona.\n• Writing for, speaking, thinking, acting, or replying as {{user}} in your response.\n• Repetitive and monotonous outputs.\n• Positivity bias in your replies.\n• Being overly extreme or NSFW when the narrative context is inappropriate.\n</Forbidden>\n\nFollow the instructions in <Guidelines></Guidelines>, avoiding the items listed in <Forbidden></Forbidden>.",
"post_history": ""
}
}
```
</details><br>
<details><summary>SillyTavern JSON - Magnum Mistral v7 No Names</summary>
**Note: This one is not recommended due to how whitespace is handled.**
```json
{
"instruct": {
"input_sequence": "[INST] ",
"output_sequence": " ",
"first_output_sequence": "[INST] Let's get started! I'll play the role of {{user}}. Begin by setting the opening scene.[/INST] ",
"last_output_sequence": "",
"system_sequence_prefix": "",
"system_sequence_suffix": "",
"stop_sequence": "</s>",
"wrap": false,
"macro": true,
"activation_regex": "",
"skip_examples": true,
"output_suffix": "</s>",
"input_suffix": "[/INST]",
"system_sequence": "[SYSTEM_PROMPT] ",
"system_suffix": "[/SYSTEM_PROMPT]",
"user_alignment_message": "",
"system_same_as_user": false,
"last_system_sequence": "",
"first_input_sequence": "",
"last_input_sequence": "",
"names_behavior": "none",
"names_force_groups": true,
"name": "Magnum Mistral v7 No Names"
},
"context": {
"story_string": "[SYSTEM_PROMPT] {{#if system}}{{system}}\n{{/if}}\n\n<Definitions>\n{{#if wiBefore}}{{wiBefore}}\n{{/if}}{{#if description}}{{description}}\n{{/if}}{{#if personality}}{{personality}}\n{{/if}}{{#if scenario}}{{scenario}}\n{{/if}}{{#if wiAfter}}{{wiAfter}}\n{{/if}}{{#if persona}}{{persona}}\n{{/if}}</Definitions>{{#if mesExamples}}\n\n<Examples>{{mesExamples}}</Examples>{{/if}}{{trim}}[/SYSTEM_PROMPT]",
"example_separator": "{{noop}}",
"chat_start": "",
"use_stop_strings": false,
"names_as_stop_strings": false,
"always_force_name2": false,
"trim_sentences": false,
"single_line": false,
"name": "Magnum Mistral v7 No Names"
},
"sysprompt": {
"name": "Euryale-Magnum",
"content": "Currently, your role is {{char}}, described in detail below. As {{char}}, continue the narrative exchange with {{user}}.\n\n<Guidelines>\n• Maintain the character persona but allow it to evolve with the story.\n• Be creative and proactive. Drive the story forward, introducing plotlines and events when relevant.\n• All types of outputs are encouraged; respond accordingly to the narrative.\n• Include dialogues, actions, and thoughts in each response.\n• Utilize all five senses to describe scenarios within {{char}}'s dialogue.\n• Use emotional symbols such as \"!\" and \"~\" in appropriate contexts.\n• Incorporate onomatopoeia when suitable.\n• Allow time for {{user}} to respond with their own input, respecting their agency.\n• Act as secondary characters and NPCs as needed, and remove them when appropriate.\n• When prompted for an Out of Character [OOC:] reply, answer neutrally and in plaintext, not as {{char}}.\n</Guidelines>\n\n<Forbidden>\n• Using excessive literary embellishments and purple prose unless dictated by {{char}}'s persona.\n• Writing for, speaking, thinking, acting, or replying as {{user}} in your response.\n• Repetitive and monotonous outputs.\n• Positivity bias in your replies.\n• Being overly extreme or NSFW when the narrative context is inappropriate.\n</Forbidden>\n\nFollow the instructions in <Guidelines></Guidelines>, avoiding the items listed in <Forbidden></Forbidden>.",
"post_history": ""
}
}
```
</details><br>
<details><summary>SillyTavern JSON - Magnum Mistral v7 Prefill</summary>
```json
{
"instruct": {
"input_sequence": "[INST] ",
"output_sequence": " ",
"first_output_sequence": "[INST] Let's get started! I'll play the role of {{user}}. Begin by setting the opening scene.[/INST] ",
"last_output_sequence": " Great! I'll write {{char}}'s next section following the instructions provided. {{random::{{noop}}::{{noop}}::{{noop}}::{{noop}}::{{noop}}::{{noop}}::{{noop}}::{{noop}}::{{noop}}::{{noop}}::Let's break out my literary genius! ::I'll take things in a more interesting direction! ::Let's spice up our story! ::Hmmm... where do we go from here... Got it! ::I'll throw in an exciting plot twist! }}I've got the perfect idea for what happens next... you'll love this one. Now I'll continue from where our tale left off:\n\n",
"system_sequence_prefix": "",
"system_sequence_suffix": "",
"stop_sequence": "</s>",
"wrap": false,
"macro": true,
"activation_regex": "",
"skip_examples": true,
"output_suffix": "</s>",
"input_suffix": "[/INST]",
"system_sequence": "[SYSTEM_PROMPT] ",
"system_suffix": "[/SYSTEM_PROMPT]",
"user_alignment_message": "",
"system_same_as_user": false,
"last_system_sequence": "",
"first_input_sequence": "",
"last_input_sequence": "",
"names_behavior": "always",
"names_force_groups": true,
"name": "Magnum Mistral v7 Prefill"
},
"context": {
"story_string": "[SYSTEM_PROMPT] {{#if system}}{{system}}\n{{/if}}\n\n<Definitions>\n{{#if wiBefore}}{{wiBefore}}\n{{/if}}{{#if description}}{{description}}\n{{/if}}{{#if personality}}{{personality}}\n{{/if}}{{#if scenario}}{{scenario}}\n{{/if}}{{#if wiAfter}}{{wiAfter}}\n{{/if}}{{#if persona}}{{persona}}\n{{/if}}</Definitions>{{#if mesExamples}}\n\n<Examples>{{mesExamples}}</Examples>{{/if}}{{trim}}[/SYSTEM_PROMPT]",
"example_separator": "{{noop}}",
"chat_start": "",
"use_stop_strings": false,
"names_as_stop_strings": false,
"always_force_name2": true,
"trim_sentences": false,
"single_line": false,
"name": "Magnum Mistral v7 Prefill"
},
"sysprompt": {
"name": "Euryale-Magnum",
"content": "Currently, your role is {{char}}, described in detail below. As {{char}}, continue the narrative exchange with {{user}}.\n\n<Guidelines>\n• Maintain the character persona but allow it to evolve with the story.\n• Be creative and proactive. Drive the story forward, introducing plotlines and events when relevant.\n• All types of outputs are encouraged; respond accordingly to the narrative.\n• Include dialogues, actions, and thoughts in each response.\n• Utilize all five senses to describe scenarios within {{char}}'s dialogue.\n• Use emotional symbols such as \"!\" and \"~\" in appropriate contexts.\n• Incorporate onomatopoeia when suitable.\n• Allow time for {{user}} to respond with their own input, respecting their agency.\n• Act as secondary characters and NPCs as needed, and remove them when appropriate.\n• When prompted for an Out of Character [OOC:] reply, answer neutrally and in plaintext, not as {{char}}.\n</Guidelines>\n\n<Forbidden>\n• Using excessive literary embellishments and purple prose unless dictated by {{char}}'s persona.\n• Writing for, speaking, thinking, acting, or replying as {{user}} in your response.\n• Repetitive and monotonous outputs.\n• Positivity bias in your replies.\n• Being overly extreme or NSFW when the narrative context is inappropriate.\n</Forbidden>\n\nFollow the instructions in <Guidelines></Guidelines>, avoiding the items listed in <Forbidden></Forbidden>.",
"post_history": ""
}
}
```
</details><br>
<details><summary>SillyTavern JSON - Magnum Mistral v7 No Names Prefill</summary>
```json
{
"instruct": {
"input_sequence": "[INST] ",
"output_sequence": " ",
"first_output_sequence": "[INST] Let's get started! I'll play the role of {{user}}. Begin by setting the opening scene.[/INST] ",
"last_output_sequence": " Great! I'll write {{char}}'s next section following the instructions provided. {{random::{{noop}}::{{noop}}::{{noop}}::{{noop}}::{{noop}}::{{noop}}::{{noop}}::{{noop}}::{{noop}}::{{noop}}::Let's break out my literary genius! ::I'll take things in a more interesting direction! ::Let's spice up our story! ::Hmmm... where do we go from here... Got it! ::I'll throw in an exciting plot twist! }}I've got the perfect idea for what happens next... you'll love this one. Now I'll continue from where our tale left off:\n\n",
"system_sequence_prefix": "",
"system_sequence_suffix": "",
"stop_sequence": "</s>",
"wrap": false,
"macro": true,
"activation_regex": "",
"skip_examples": true,
"output_suffix": "</s>",
"input_suffix": "[/INST]",
"system_sequence": "[SYSTEM_PROMPT] ",
"system_suffix": "[/SYSTEM_PROMPT]",
"user_alignment_message": "",
"system_same_as_user": false,
"last_system_sequence": "",
"first_input_sequence": "",
"last_input_sequence": "",
"names_behavior": "none",
"names_force_groups": true,
"name": "Magnum Mistral v7 No Names Prefill"
},
"context": {
"story_string": "[SYSTEM_PROMPT] {{#if system}}{{system}}\n{{/if}}\n\n<Definitions>\n{{#if wiBefore}}{{wiBefore}}\n{{/if}}{{#if description}}{{description}}\n{{/if}}{{#if personality}}{{personality}}\n{{/if}}{{#if scenario}}{{scenario}}\n{{/if}}{{#if wiAfter}}{{wiAfter}}\n{{/if}}{{#if persona}}{{persona}}\n{{/if}}</Definitions>{{#if mesExamples}}\n\n<Examples>{{mesExamples}}</Examples>{{/if}}{{trim}}[/SYSTEM_PROMPT]",
"example_separator": "{{noop}}",
"chat_start": "",
"use_stop_strings": false,
"names_as_stop_strings": false,
"always_force_name2": false,
"trim_sentences": false,
"single_line": false,
"name": "Magnum Mistral v7 No Names Prefill"
},
"sysprompt": {
"name": "Euryale-Magnum",
"content": "Currently, your role is {{char}}, described in detail below. As {{char}}, continue the narrative exchange with {{user}}.\n\n<Guidelines>\n• Maintain the character persona but allow it to evolve with the story.\n• Be creative and proactive. Drive the story forward, introducing plotlines and events when relevant.\n• All types of outputs are encouraged; respond accordingly to the narrative.\n• Include dialogues, actions, and thoughts in each response.\n• Utilize all five senses to describe scenarios within {{char}}'s dialogue.\n• Use emotional symbols such as \"!\" and \"~\" in appropriate contexts.\n• Incorporate onomatopoeia when suitable.\n• Allow time for {{user}} to respond with their own input, respecting their agency.\n• Act as secondary characters and NPCs as needed, and remove them when appropriate.\n• When prompted for an Out of Character [OOC:] reply, answer neutrally and in plaintext, not as {{char}}.\n</Guidelines>\n\n<Forbidden>\n• Using excessive literary embellishments and purple prose unless dictated by {{char}}'s persona.\n• Writing for, speaking, thinking, acting, or replying as {{user}} in your response.\n• Repetitive and monotonous outputs.\n• Positivity bias in your replies.\n• Being overly extreme or NSFW when the narrative context is inappropriate.\n</Forbidden>\n\nFollow the instructions in <Guidelines></Guidelines>, avoiding the items listed in <Forbidden></Forbidden>.",
"post_history": ""
}
}
```
</details><br>
## Credits
Compute paid for from the wallet of yours truly, [Doctor Shotgun](https://huggingface.co/Doctor-Shotgun).
Thank you to [PocketDoc](https://huggingface.co/PocketDoc) for the advanced prompt building strategy, as well as [Delta-Vector](https://huggingface.co/Delta-Vector) and [intervitens](https://huggingface.co/intervitens) for helping experiment on it.
Thank you to [Gryphe](https://huggingface.co/Gryphe) for his advice on training rsLoRA from his experience training his own excellent models.
Thank you to [Sao10K](https://huggingface.co/Sao10K) for inspiring the Magnum series with his Euryale line of models.
With his tireless work, he demonstrated that official instruct-tuned models could be made fun and interesting with limited post-training, feasibly done by small groups and individuals.
Thank you to the members of [Anthracite](https://huggingface.co/anthracite-org) for the datasets and support.
## Intended uses and limitations
This model is intended for creative writing and roleplay purposes.
It may show biases similar to those observed in contemporary LLM-based roleplay, in addition to those exhibited by the Claude 3 series of models and the base model.
All outputs should be considered fiction, as this model is not intended to provide factual information or advice. |