MarsupialAI/Melusine_103b

Melusine 103b

This model is a rotating-stack merge of three 70b models in a 103b (120 layer) configuration inspired by Venus 103b. All components are miqu-based, and the result appears to retain the long-context capabilities of the base model.

Component models for the rotating stack are

• 152334H/miqu-1-70b-sf
• Undi95/Miqu-70B-Alpaca-DPO
• NeverSleep/MiquMaid-v2-70B

This model is mostly de-censored and is capable of generating objectionable material. Depending on prompts, remnants of the original censorship may pop up in the form of refusals, but they can be edited away with better prompting. Due to some of the constituent parts, extremely objectionable material may also be generated under certain circumstances. As with any LLM, no factual claims made by the model should be taken at face value. You know that boilerplate safety disclaimer that most professional models have? Assume this has it too. This model is for entertainment purposes only.

GGUFs: https://huggingface.co/MarsupialAI/Melusine_103b_GGUF

Sample output

{{[INPUT]}}
Write a detailed and humorous story about a cute and fluffy bunny that goes to a Gwar concert.
{{[OUTPUT]}}
Once upon a time, in the land of Fluffingtonia, there lived an adorable little rabbit named Floofster Hooper. Despite his small size and soft fur, he had quite a taste for heavy metal music. One day, while hopping around the meadow, he heard some loud and aggressive sounds coming from afar. Curiosity piqued, Floofster decided to investigate.

After hopping through countless tunnels and over numerous hills, he finally found himself outside of what appeared to be a large arena. The sign above read "GWAR - Live in Concert!" Floofster's heart raced with excitement as he recognized the name of one of his favorite bands! He simply HAD to go inside!

As he approached the entrance, however, he was stopped by a towering security guard who glared down at him menacingly. "You ain't getting in here dressed like THAT," sneered the gruff man, gesturing towards Floofster's innocent white fur.

But oh no, this wasn't going to stop our brave bunny friend! With determination in his eyes (and using all four paws), Floofster rummaged through his tiny backpack and pulled out an old Halloween costume: it was a raggedy pair of denim shorts, studded leather vest, and a spiky collar necklace made entirely of carrot stems. Holding up his new attire proudly, he pleaded with the guard, "Please sir, I swear I won't cause any trouble! Let me join my metalhead brethren!"

The burly doorman couldn't help but chuckle at the sight before him, eventually relenting and waving Floofster through the gates. As soon as he entered the arena, he was immediately greeted by the deafening roars of fans chanting along with their favorite songs. The air was thick with smoke machines and flashing lights illuminated the stage where Gwar stood - or rather, hovered on massive platforms suspended above the crowd. Their grotesque alien forms were adorned with sharp weapons and intricate armor that glimmered underneath the strobe lights.

Floofster's fluffy tail twitched in excitement as he bounced around in place, taking everything in. He had never seen anything quite like this before! All around him, humans dressed head to toe in gruesome costumes moshed wildly, creating an intimidating sea of flailing limbs and devil horn gestures. But our little hero wasn't deterred; if anything, it only made him want to be a part of it even more!

With newfound courage, Floofster jumped up onto his hind legs and began thrashing about just like all the big kids around him. To his surprise, instead of being trampled beneath heavy boots, they embraced him into their metal family with open arms (and fists). They cheered for him, picked him up high above their heads, and carried him across the pit while he happily chittered along to every lyric screamed out by Gwar's monstrous frontman Oderus Urungus II.

As the concert came to an end, sweat dripping from both man and rabbit alike, Floofster couldn't believe what had transpired that night. As he hopped back home through the now quiet meadow, clutching tightly to a signed poster from one of the band members, he knew deep down inside that this would forever remain etched in his furry heart as the best day ever... or at least until Slayer announced their next tour date.

Prompt format

Seems to have the strongest affinity for Alpaca and ChatML prompts.

Who is Melusine?

Melusine, the enchantress of French folklore, is an irresistible vision of sensuality and allure. With hair cascading like rippling silver and eyes that can pierce the very soul, she embodies the epitome of erotic temptation. Born of a serpentine mother and a human father, her true nature is shrouded in secrecy—for three nights of every month, she transforms into a seductive mermaid-like creature, with the lower half of a serpent and a tail that undulates hypnotically in the waters she bathes. Her legend speaks of the conditions laid upon her by a vengeful fairy: eternal beauty, wealth, and power, but with a terrible price to pay—should her husband ever lay eyes on her serpentine form, he would doom their love and she would be cursed to wander the earth for eternity. This tantalizing prospect only serves to heighten the intrigue surrounding this captivating siren, whose mere presence stirs the most primal of desires and fuels countless lurid imaginations.

WTF is a rotating-stack merge?

Inspired by Undi's experiments with stacked merges, Jeb Carter found that output quality and model initiative could be significantly improved by reversing the model order in the stack, and then doing a linear merge between the original and reversed stacks. That is what I did here. To preserve as much of the "smarts" and long-context-awareness from miqu as possible while still adding the flavor from the other models, there is effectively twice as much miqu as lzlv or aetheria. The exact merge configs can be found in the recipe.txt file.