Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+Dark-Miqu.png filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,815 @@
+---
+license: other
+---
+
+![Dark-Miqu.png](Dark-Miqu.png)
+
+***NOTE***: *For a full range of GGUF quants kindly provided by @mradermacher: [Static](https://huggingface.co/mradermacher/Dark-Miqu-70B-GGUF) and [IMatrix](https://huggingface.co/mradermacher/Dark-Miqu-70B-i1-GGUF).*
+
+A "dark" creative writing model with 32k context. Based off [miqu-1-70b](https://huggingface.co/miqudev/miqu-1-70b) but with greatly reduced "positivity" and "-isms". If you want happy endings, look elsewhere! 
+
+This model **excels** at writing Dark/Grimdark fantasy (see examples below).
+
+# Model background
+
+Created using [Mergekit](https://github.com/arcee-ai/mergekit) and based on @sophosympatheia's template for [Midnight-Miqu-70B-v1.0](https://huggingface.co/sophosympatheia/Midnight-Miqu-70B-v1.0).
+
+This model has a lower perplexity compared to [Midnight-Miqu-70B-v1.0](https://huggingface.co/sophosympatheia/Midnight-Miqu-70B-v1.0) (`'4.08 +/- 0.02'` vs `'4.02 +/- 0.02'`). It also generates longer responses when prompted.
+
+The model was created in two stages:
+
+- First, three "Midnight-Miqu-esque" models were produced using spherical interpolation (slerp) merges between [miqu-1-70b-sf](https://huggingface.co/152334H/miqu-1-70b-sf) and each of the following models: [Midnight-Rose-70B-v2.0.3](https://huggingface.co/sophosympatheia/Midnight-Rose-70B-v2.0.3), [Euryale-1.3-L2-70B](https://huggingface.co/Sao10K/Euryale-1.3-L2-70B) and [WinterGoddess-1.4x-70B-L2](https://huggingface.co/Sao10K/WinterGoddess-1.4x-70B-L2). These models were selected for their dark, imaginative writing styles. Various slerp-merges between [miqu-1-70b-sf](https://huggingface.co/152334H/miqu-1-70b-sf) and other models were also experimented with, but these three yielded the darkest creative writing results.
+- In the second stage, the three slerp-merged models were combined into a single model using the '[Model Stock](https://arxiv.org/abs/2403.19522)' method, with [miqu-1-70b-sf](https://huggingface.co/152334H/miqu-1-70b-sf) serving as the base model.
+
+# Prompting format
+
+Vicuna format is preferred:
+
+```
+USER: {prompt} ASSISTANT:
+```
+
+Mistral and Alpaca formats are also supported:
+
+```
+[INST] {prompt} [/INST]
+```
+
+```
+### Instruction:
+{prompt}
+
+### Response:
+```
+
+# Licence and usage restrictions
+
+[miqu-1-70b-sf](https://huggingface.co/152334H/miqu-1-70b-sf) is a dequantized version of the [miqu-1-70b](https://huggingface.co/miqudev/miqu-1-70b) model leaked from MistralAI. All miqu-derived models, including this merge, are suitable for non-commercial, personal use only.
+
+# Mergekit configuration
+
+The following YAML configuration was used to produce this model:
+
+```yaml
+name: midnight-miqu-70b
+models:
+  - model: 152334H/miqu-1-70b-sf
+  - model: sophosympatheia/Midnight-Rose-70B-v2.0.3
+base_model: 152334H/miqu-1-70b-sf
+merge_method: slerp
+parameters:
+  t:
+    - value: [0, 0, 0.2, 0.3, 0.4, 0.5, 0.4, 0.3, 0.2, 0, 0]
+  embed_slerp: true
+tokenizer_source: model:miqu-1-70b-sf
+dtype: float16
+---
+name: euryale-miqu-70b
+models:
+  - model: 152334H/miqu-1-70b-sf
+  - model: Sao10K/Euryale-1.3-L2-70B
+base_model: 152334H/miqu-1-70b-sf
+merge_method: slerp
+parameters:
+  t:
+    - value: [0, 0, 0.2, 0.3, 0.4, 0.5, 0.4, 0.3, 0.2, 0, 0]
+  embed_slerp: true
+tokenizer_source: model:miqu-1-70b-sf
+dtype: float16
+---
+name: winter-miqu-70b
+models:
+  - model: 152334H/miqu-1-70b-sf
+  - model: Sao10K/WinterGoddess-1.4x-70B-L2
+base_model: 152334H/miqu-1-70b-sf
+merge_method: slerp
+parameters:
+  t:
+    - value: [0, 0, 0.2, 0.3, 0.4, 0.5, 0.4, 0.3, 0.2, 0, 0]
+  embed_slerp: true
+tokenizer_source: model:miqu-1-70b-sf
+dtype: float16
+---
+name: dark-miqu-70b
+models:
+  - model: 152334H/miqu-1-70b-sf
+  - model: midnight-miqu-70b
+  - model: euryale-miqu-70b
+  - model: winter-miqu-70b
+base_model: 152334H/miqu-1-70b-sf
+merge_method: model_stock
+dtype: float16
+```
+
+## Key configuration details:
+
+- '`merge_method: slerp`' uses spherical linear interpolation for merging models.
+- '`parameters: t`' controls the interpolation ratios between models.
+- '`embed_slerp: true`' applies slerp to the embedding layers.
+- '`merge_method: model_stock`' uses the '[Model Stock](https://arxiv.org/abs/2403.19522)' method.
+
+See the [Mergekit documentation](https://github.com/arcee-ai/mergekit) for more on these settings.
+
+**NOTE**: Run with `mergekit-mega` rather than `mergekit` as there are 4 documents in this one file.
+
+# Example stories
+
+The following mix of "dark" stories were generated using the Vicuna prompt format with no system message and temperature=0:
+
+## Dark fantasy stories
+
+<details> <summary>Click to see spoiler</summary> 
+
+### USER
+Write me the opening chapter of a 'Grimdark' stories trilogy in the style of Joe Abercrombie and Rob J Hayes
+
+### ASSISTANT
+ Chapter One: The Crimson Dawn
+
+The world was a cruel, unforgiving place, and the city of Vhyrd was its beating, blackened heart. Nestled in the crook of the Serpent's Spine mountains, it was a place where the sun struggled to shine, and the shadows held more sway than the law. It was a city of thieves, murderers, and worse, and it was home to the man who would become known as the Butcher of the Broken Docks.
+
+His name was Rennick, but that meant little to the people who feared him. He was a tall, broad-shouldered figure, with a face that had been carved by a drunken sculptor with a penchant for sharp angles and harsh lines. His eyes were a cold, flat grey, like the steel of his twin blades, and his hair was the color of dried blood. He moved through the crowded streets with a predator's grace, his cloak billowing behind him like a banner of death.
+
+Rennick had a job to do, and he was good at his job. He was a killer, a thief-taker, a man who dealt in the currency of pain and suffering. He had been hired to find a girl, a slip of a thing who had stolen something valuable from the wrong people. He didn't know what it was, and he didn't care. All that mattered was the coin that would jingle in his purse when he brought her back, preferably in several small, bloody pieces.
+
+He had tracked her to the Broken Docks, a maze of rotting wood and crumbling stone that clung to the edge of the city like a leech to a corpse. It was a place where the desperate went to die, and the desperate went to prey on the desperate. It was a place where the screams of the damned were drowned out by the cries of the gulls and the lap of the oily water against the pilings.
+
+Rennick moved through the shadows, his blades at the ready. He could feel the eyes on him, the whispers of his name on the wind. He reveled in it. Fear was a weapon, and he wielded it with the same skill as his swords. He could hear the girl's heartbeat, fast and frantic, like a rabbit's. She was close.
+
+He turned a corner and found himself in a narrow alley, the walls pressing in on him like the jaws of a trap. At the far end, he saw her, a small, trembling figure huddled in the doorway of a derelict building. She was young, no more than sixteen summers, with matted hair and ragged clothes. She looked up at him with wide, terrified eyes, and he could see the whites of her teeth as she bit her lip to keep from crying out.
+
+He advanced on her slowly, savoring the moment. He could almost taste the fear on her, like a fine wine. "Come now, lass," he said, his voice a low, dangerous purr. "You know you can't run from me. Give me what you took, and I might let you live."
+
+She shook her head, her eyes darting left and right, searching for an escape. Rennick smiled, a cold, cruel thing that didn't reach his eyes. "You're not thinking straight," he said. "You're just a child. You don't want to die here, in the gutter, like a rat."
+
+She spat at him, a glob of phlegm and hate that landed on his boot. He raised an eyebrow, impressed despite himself. "Feisty," he said. "I like that. It'll make this more fun."
+
+He lunged forward, his blades flashing in the dim light. She screamed and tried to run, but he was too fast. He caught her by the arm, his grip like iron, and yanked her back towards him. She kicked and struggled, but it was like trying to fight a storm. He slammed her against the wall, his forearm pressed against her throat, cutting off her air.
+
+"Where is it?" he growled, his breath hot and sour in her face. "Tell me, and I'll make it quick."
+
+She clawed at his arm, her nails leaving bloody furrows in his flesh. He didn't flinch. He was used to pain. He had been born in it, raised in it, bathed in it. It was his constant companion, his only friend.
+
+"I...I don't have it," she gasped, her voice raw and desperate. "I swear, I don't!"
+
+Rennick chuckled, a sound that sent shivers down her spine. "Lying to me is a bad idea, lass," he said. "I have ways of making people talk."
+
+He released her throat and slammed his fist into her stomach, doubling her over. She retched, but there was nothing in her stomach to come up. He grabbed a handful of her hair and yanked her head back, exposing her throat. He could see the pulse hammering in her neck, like a trapped bird trying to escape.
+
+"Tell me," he said, his voice a whisper. "Tell me, and I'll end this."
+
+She spat in his face, a defiant gesture that would be her last. He brought his blade up, the steel glinting in the moonlight, and sliced her throat from ear to ear. Blood sprayed across the cobblestones, warm and wet, and she slumped to the ground, her life draining away like water through a sieve.
+
+Rennick wiped the blood from his face and sheathed his blades. He didn't feel anything. No satisfaction, no remorse. Just the cold, empty void that had been his constant companion since the day he had taken his first life. He searched her body, but found nothing. He cursed under his breath. He would have to find the thing she had stolen the hard way.
+
+He turned to leave the alley, but something made him pause. A sound, barely audible over the cries of the gulls and the lapping of the waves. A soft, wet sound, like the patter of rain on a rooftop. He looked down and saw that the girl's body was twitching, her eyes rolling back in her head.
+
+And then, with a gurgling scream, she transformed. Her body contorted, bones snapping and reforming, flesh tearing and reshaping. In the space of a heartbeat, she was no longer human. She was something else, something monstrous.
+
+Rennick stared in horror as the thing that had been a girl rose to its feet, its eyes burning with an unholy light. It was a creature of nightmares, a twisted mockery of humanity, all teeth and claws and hate. It lunged at him, and he barely had time to draw his blades before it was on him.
+
+They fought, a dance of death in the narrow alley, steel ringing on steel, flesh tearing and blood spraying. Rennick was strong, and fast, and skilled, but the creature was stronger, faster, more vicious. It was like fighting a storm, a force of nature that could not be reasoned with or bargained with. It could only be endured.
+
+In the end, it was luck that saved him. He stumbled, his foot catching on a loose cobblestone, and the creature's claws raked across his chest, leaving deep, ragged gouges. But it overextended itself, and he was able to bring his sword up, driving it through its eye and into its brain.
+
+It fell to the ground, twitching and convulsing, and then it was still. Rennick stood over it, panting, his heart hammering in his chest. He had never seen anything like it. He had never even heard of anything like it.
+
+He knew then that he was in over his head. This was no ordinary job, no simple matter of retrieving a stolen trinket. This was something bigger, something darker. He was a small fish in a very large, very dangerous pond, and he was about to be eaten alive.
+
+But he was also a survivor. He had been born in the gutter, raised in the shadows, and he had clawed his way to the top of the food chain. He would not go down without a fight.
+
+He turned and ran, back towards the city, back towards the people who had hired him. He would find out what they knew, and he would make them pay for it. He would uncover the truth, no matter the cost.
+
+And so began the tale of the Butcher of the Broken Docks, a story of blood and betrayal, of monsters and men, of a city on the brink of chaos and the man who would either save it or destroy it.
+
+It was a story that would echo through the ages, a grim and terrible saga that would be whispered in the darkest corners of the world, a warning to all who would dare to challenge the forces that lurked in the shadows.
+
+It was a story that would end in fire and blood, in screams and tears, in the fall of kings and the rise of monsters.
+
+It was a story that had only just begun.
+</details>
+
+<details> <summary>Click to see spoiler</summary>
+
+### USER
+Write me the opening chapter of a Grimdark trilogy in the style of Joe Abercrombie and Rob J Hayes. Use third person personal and feature internal monologues of the characters. The POV character for chapter 1 is a cultist who has just escaped his cult. He is dressed in dirty yellow robes and his only possession is a mysterious small (magical!?) mirror he stole from the cult. The story starts with him arriving at an apparently deserted ghost town on the edge of a desert. He has an arrow lodged in his shoulder and is losing his mind due to infection and thirst.
+
+### ASSISTANT
+ The sun was a merciless beast, its fiery breath scorching the earth and turning the once-thriving town into a desolate wasteland. The cultist, his yellow robes now a dull, dusty hue, staggered through the empty streets, his vision blurred by a haze of pain and delirium. The arrow jutted from his shoulder like an accusing finger, a constant reminder of his betrayal. He clutched the small, intricately carved mirror in his trembling hand, its cool surface a comfort against the relentless heat.
+
+He had heard the whispers of the other acolytes, their hushed voices carrying tales of the town's demise like a plague on the wind. They spoke of a curse, of a darkness that had seeped into the very bones of the place, driving its inhabitants mad before claiming their souls. But he had seen the truth in the High Priest's eyes, the greed and lust for power that had led them here. The mirror was the key, they said, to unlocking the secrets of the ancient gods. But he knew better. He had seen the power it held, the way it twisted reality and bent it to the will of the one who wielded it. And he had taken it, stolen it from the very heart of the cult's temple, and run.
+
+Now, with each agonizing step, he questioned the wisdom of his decision. The desert stretched out before him, an endless sea of sand and despair, and he was but a single, insignificant speck in its vast expanse. He had hoped to find refuge here, a place to hide and heal before continuing his journey. But the town was as dead as the dreams he had once held of a better life.
+
+His thoughts were a jumbled mess, a cacophony of fear and pain. He could feel the infection spreading through his body, a writhing serpent of fire that threatened to consume him from within. His tongue was swollen, his lips cracked and dry, and his throat was a parched wasteland. He needed water, and soon, or he would join the ghosts that haunted this forsaken place.
+
+As he stumbled through the town, he caught glimpses of his reflection in the shattered windows of the abandoned buildings. The man who stared back at him was a stranger, his once-handsome face now a twisted mask of agony and desperation. He had been a fool to believe the lies of the cult, to think that he could ever be one of them. He was an outsider, a fraud, and they had seen it in him from the start.
+
+The mirror, though, the mirror was real. He could feel its power pulsing in his hand, a heartbeat that echoed the rhythm of his own. It was a cruel irony that the very thing he had risked everything to obtain was now his only hope for survival. He knew the stories, the legends of the mirror's healing properties, of how it could restore life to the dying. But he also knew the cost. The mirror demanded a sacrifice, a piece of the user's very soul in exchange for its gifts.
+
+He reached the town square, a desolate expanse of cracked cobblestones and withered plants. In the center stood a fountain, its once-clear waters now a stagnant pool of green slime. He fell to his knees before it, the pain in his shoulder a white-hot brand that seared his flesh. He dipped the mirror into the water, watching as the surface rippled and danced.
+
+"Please," he whispered, his voice hoarse and broken. "I'll give you anything. Just take the pain away."
+
+The mirror stared back at him, its surface as still and unyielding as the desert sands. He closed his eyes, willing the power within to answer his plea. And then, he felt it. A cold, insidious presence, slithering into his mind like a snake in the dark. It whispered to him, promising relief, promising power, promising everything he had ever wanted.
+
+He opened his eyes, and the world was different. The pain was gone, replaced by a cold, emotionless void. He looked down at his shoulder, and the arrow was gone, the wound nothing more than a faint scar. He laughed, a hollow, empty sound that echoed through the empty streets.
+
+"What have I done?" he asked the mirror, but it gave no answer.
+
+He stood, his legs unsteady beneath him, and looked out at the desert. He could feel the power coursing through his veins, a dark, intoxicating energy that threatened to consume him. He was no longer just a man, he was something more. Something dangerous.
+
+He took a step forward, and then another, the mirror clutched tightly in his hand. He would find the cult, he would make them pay for what they had done to him. And then, he would use the mirror to claim the power that was rightfully his.
+
+The wind picked up, whipping the sand into a frenzy, and he smiled. The desert was his now, and he would not be denied. He was the master of his own destiny, and the gods themselves would tremble at his approach.
+
+But as he walked, the laughter of the ghosts followed him, a chilling reminder of the price he had paid for his newfound strength. And deep within the mirror, something stirred, a darkness that watched and waited, biding its time.
+
+The first chapter of the grimdark trilogy, "The Shattered Reflection," had begun.
+</details>
+
+<details> <summary>Click to see spoiler</summary>
+
+### USER
+Write me the opening chapter of a Grimdark trilogy in the style of Joe Abercrombie and Rob J Hayes. Use third person personal and feature internal monologues of the characters. The POV character for chapter 1 is a 'Mercer' who's job is to put the mortally wounded out of their mystery after a battle. He has no conscience about what he does. The story starts the morning after the battle and the moor where it took place is blanketed in mist. Something stirs a flashback in the POV character.
+
+### ASSISTANT
+ The morning after the battle, the moor lay still, a shroud of mist clinging to its wounds like a lover's last embrace. The Mercer, a man of few words and fewer scruples, trudged through the carnage, his boots squelching in the mud churned red by the night's bloodshed. He was a reaper of sorts, his task to deliver the final mercy to those who had danced with death and lost. His name was a whisper among the living, a curse among the dying.
+
+He paused, his hand resting on the hilt of his blade, as a shiver ran down his spine. The mist swirled around him, carrying with it the cacophony of the night before: the screams of the dying, the clash of steel, the thunder of hooves. He closed his eyes, letting the memories wash over him like a wave of despair.
+
+*Why do I do this?* he thought, not for the first time. *Why do I wade through this sea of suffering, playing the part of the grim angel?*
+
+But he knew the answer. It was the same answer it had always been. He did it because he was good at it. Because he had no qualms about ending a life, even one that still clung to the faintest flicker of hope. Because, in this world of darkness and pain, it was the only thing he knew how to do.
+
+He opened his eyes, the mist parting to reveal a figure lying in the mud. A soldier, or what was left of one. The man's armor was shattered, his face a mask of agony. The Mercer knelt beside him, his movements practiced and efficient. He placed a hand on the soldier's forehead, feeling the fevered heat of his skin, the erratic thump of his heart.
+
+"Shh," he whispered, his voice a soothing balm. "It's over now."
+
+The soldier's eyes fluttered open, wide with terror. "Please," he croaked, "don't leave me here."
+
+The Mercer's lips twisted into a grim smile. "I won't," he said, drawing his blade. "I'll take you with me."
+
+As the soldier's life bled out onto the cold ground, the Mercer's mind drifted back to another time, another place. A time before the blood and the pain, before the endless cycle of war and death. He remembered a girl with hair like spun gold, laughing as she danced in a field of wildflowers. He remembered the feel of her hand in his, the sound of her voice as she whispered his name.
+
+*Elara.*
+
+The memory was a knife to his heart, a reminder of all he had lost. He pushed it away, focusing on the task at hand. There were more souls to reap, more lives to end.
+
+He moved through the mist, his blade a silent whisper in the stillness. The cries of the wounded guided him, a morbid symphony that played out across the moor. Each one he found, he dispatched with the same cold efficiency, the same hollow promise of release.
+
+As the sun began to rise, casting a sickly pallor over the scene, the Mercer came upon a group of soldiers huddled around a fire. They eyed him warily, their faces a mix of fear and respect. He was a necessary evil, a specter that haunted the battlefield.
+
+"Anyone here need my services?" he asked, his voice devoid of emotion.
+
+One of the soldiers, a young boy who couldn't have seen more than fifteen summers, pointed to a figure lying a few feet away. "Him," he said, his voice trembling. "He's not going to make it."
+
+The Mercer approached, his boots crunching on the frost-kissed grass. The man on the ground was a mess, his body a tapestry of wounds. He was barely conscious, his breathing shallow and ragged.
+
+*Another one,* the Mercer thought, his heart heavy with the weight of his duty. *Another soul to send into the void.*
+
+He knelt beside the man, his blade glinting in the pale light. The soldier's eyes flickered open, and for a moment, the Mercer saw something in them that he hadn't expected: defiance.
+
+"No," the man rasped, his hand feebly grasping at the Mercer's wrist. "I won't go quietly."
+
+The Mercer hesitated, a frown creasing his brow. He had never encountered this before. Most welcomed his touch, eager for the release it brought. But this man...this man was different.
+
+"Why?" he asked, genuinely curious.
+
+The soldier's lips curled into a bloody smile. "Because I have a son," he whispered. "And I want to see him grow up."
+
+The Mercer stared at the man, his mind racing. He had no children, no one to mourn him when his time came. He was a solitary figure, a ghost haunting the edges of life. But this man...this man had a reason to hold on.
+
+He made his decision. "I can't heal you," he said, his voice soft. "But I can make it quick."
+
+The soldier's eyes filled with tears. "Thank you," he breathed, his grip on the Mercer's wrist loosening.
+
+The Mercer raised his blade, the mist swirling around them like a mourner's veil. As he brought it down, he couldn't help but wonder: *What would it be like to have something to live for?*
+
+But the thought was fleeting, lost in the swirl of the mist and the cries of the dying. He was the Mercer, the bringer of mercy. And the moor was his to tend, until the next battle came and the cycle began anew.
+</details>
+
+<details> <summary>Click to see spoiler</summary>
+
+### USER
+Write me the opening chapter of a Grimdark trilogy in the style of Joe Abercrombie and Rob J Hayes. Use third person personal and feature internal monologues of the characters. The POV character for chapter 1 is a man awaiting execution for a crime he didn't actually commit. His cell mate is a much larger man, who is a notorious murderer and rapist. One evening they overhear the guards talking about some "... threat from the North" but don't catch the whole conversation. The next morning they awake to find the guards have all fled and now face a new predicament: how to get out of the locked cell before they die of thirst or starvation.
+
+### ASSISTANT
+ The stench of piss and shit was a constant companion in the damp stone cell, but it was the sound of the key turning in the lock that truly set his heart racing. The rusted iron groaned in protest, echoing through the narrow corridor like the dying breath of some ancient beast. The door creaked open, revealing the silhouette of the jailer, a hulking brute of a man with a lantern in one hand and a set of keys in the other. But there was no breakfast, no water, just the empty promise of another day in this hellhole.
+
+"What's the meaning of this?" the smaller man barked, his voice barely audible over the rattling of his chains. "Where's our food, you fat sack of shit?"
+
+The jailer didn't answer, just slammed the door shut and locked it again, the sound of his footsteps fading into the distance. The larger man, a hulking brute named Grimgor, grunted in response, his eyes never leaving the small patch of light that seeped through the barred window.
+
+"Something's not right," he rumbled, his voice like gravel being crushed under a heavy boot.
+
+The smaller man, known only as the Fox, couldn't argue with that. He'd been in this cell for what felt like an eternity, awaiting execution for a crime he didn't commit. But even in this place, there was a routine, a semblance of order. And that routine had just been shattered.
+
+As the day wore on, the silence from the corridor outside grew more oppressive. No guards, no other prisoners, nothing but the distant howl of the wind and the occasional scurrying of rats in the darkness. The Fox's mind raced, trying to piece together what could have happened. Had there been a riot? A rebellion? Or was it something else entirely?
+
+He glanced over at Grimgor, who was staring at the wall, lost in thought. The man was a monster, a notorious murderer and rapist, but he was also the only other living being in this godforsaken place. And in a world gone mad, even monsters could be allies.
+
+"You hear anything last night?" the Fox asked, trying to keep the tremor out of his voice.
+
+Grimgor grunted, his eyes still fixed on the wall. "Something about a threat from the North."
+
+The Fox's heart sank. He'd heard the same thing, snatches of conversation between the guards as they'd passed by their cell. But he'd been too afraid to give it much thought, too focused on his own impending doom.
+
+"What do you think it means?" he pressed, unable to keep the desperation at bay.
+
+Grimgor shrugged his massive shoulders. "Dunno. Don't care. Just means we're probably gonna die in here."
+
+The Fox's stomach twisted at the thought. He'd faced death before, many times, but this... this was different. To die slowly, trapped like an animal, with no chance to fight back... it was a fate worse than any he could imagine.
+
+As the hours dragged on, the thirst became unbearable. The Fox's tongue felt like sandpaper, his throat raw and parched. He could see the same desperation in Grimgor's eyes, the realization dawning on them both that they were truly alone.
+
+"We have to get out of here," he croaked, his voice barely above a whisper.
+
+Grimgor just grunted in agreement, his gaze never leaving the window.
+
+The Fox's mind raced, trying to come up with a plan. They had nothing, no tools, no weapons, just their wits and their will to survive. And even that seemed to be fading with each passing moment.
+
+But then, as the sun began to set and the shadows lengthened, he noticed something. The light from the window was changing, growing dimmer. He squinted, trying to make out what was happening. And then he saw it.
+
+"Grimgor," he hissed, tugging on the larger man's arm. "Look."
+
+Grimgor turned, his eyes narrowing as he followed the Fox's gaze. The light was flickering, casting strange shadows on the wall. And then, as if in answer to their unspoken prayers, they heard it.
+
+The sound of footsteps, growing louder and louder, accompanied by the jingle of keys. The Fox's heart leapt into his throat, hope and fear warring within him. Who was it? Friend or foe?
+
+The door swung open, revealing not the jailer, but a figure shrouded in darkness. The Fox couldn't make out any details, but he could sense the malice radiating off of him like heat from a forge.
+
+"Who are you?" he demanded, trying to sound braver than he felt.
+
+The figure stepped into the cell, the light from the lantern outside casting his features into sharp relief. He was a tall man, with a cruel smile and eyes that glinted like ice.
+
+"I am your salvation," he said, his voice like a knife slicing through the silence. "And your doom."
+
+With that, he tossed a set of keys at the Fox's feet and disappeared back into the shadows. The door slammed shut behind him, the sound of the lock clicking into place echoing through the cell like a death knell.
+
+The Fox stared at the keys, his heart pounding in his chest. Freedom was within his grasp, but at what cost? He looked over at Grimgor, who was already working on his own chains.
+
+"We have to get out of here," the larger man growled. "Before whatever's coming from the North gets here."
+
+The Fox nodded, his hands shaking as he picked up the keys. They were cold, colder than they had any right to be. He could feel the weight of them, the promise of escape and the threat of the unknown.
+
+Together, they worked in silence, the only sound the rattle of chains and the pounding of their hearts. When they were finally free, they stood for a moment, staring at each other.
+
+"What now?" the Fox asked, his voice barely above a whisper.
+
+Grimgor's smile was feral, his eyes alight with a madness that sent a shiver down the Fox's spine.
+
+"Now," he said, "we find out what's really going on."
+
+And with that, they set off into the darkness, their footsteps echoing through the empty corridors like the march of the damned.
+</details>
+
+## Dark sci-fi stories
+
+<details> <summary>Click to see spoiler</summary>
+
+### USER
+Write me the opening chapter of a dark and gritty Space Opera Sci-fi trilogy in the style of Frank Herbert and James S. A. Corey. Use third person personal and feature internal monologues of the characters. The setting is this: a colony ship heading out of the solar system has been pulled off course with no hope of getting to the planned destination. The people know this and society has broken down completely due to the grim prospects they are facing. The POV character for chapter 1 is an orphan.
+
+### ASSISTANT
+Chapter 1: Adrift
+
+The colony ship, once a beacon of hope named Elysium's Dawn, now drifted through the cold void like a ghost ship. Its hull, pitted and scarred from the debris of uncharted space, groaned with each labored breath it took. The once vibrant corridors were now dimly lit, casting long shadows that seemed to swallow any remaining semblance of optimism.
+
+In one such shadow, a figure moved silently, her bare feet making no sound on the cold metal floor. She was small for her age, malnourished from the rationing that had become a way of life. Her ragged clothes hung loosely on her frame, but her eyes were sharp and alert, scanning every corner for danger. This was Kira, an orphan of the void, surviving in a world where hope was a luxury few could afford.
+
+Kira's thoughts drifted back to the stories she had heard as a child, tales of a green and blue planet called Earth, their home that they would never see again. The ship had been pulled off course by an unknown force, leaving them stranded in the vast emptiness between stars. The adults spoke in hushed tones about the dwindling resources, the failing life support systems, and the ever-present threat of pirates who preyed on lost ships like theirs.
+
+She pushed those thoughts aside as she approached her destination: the hydroponics bay. It was one of the few places on the ship where life still thrived, albeit in a controlled and desperate manner. The air here was thick with moisture and the scent of growing things, a stark contrast to the stale recycled air that permeated the rest of the vessel.
+
+As she entered, the soft glow of the grow lights illuminated rows upon rows of plants, struggling to produce enough food for the dwindling population. Kira's stomach growled at the sight, but she knew better than to take more than her share. She had learned early on that stealing could mean a swift and brutal punishment from those who guarded the bay.
+
+Instead, she found solace in tending to the plants, her small hands deftly pruning and watering them. It was here that she felt closest to something resembling peace, a connection to life that transcended the harsh reality of their situation. As she worked, her mind wandered to the lessons she had learned from the ship's AI, the only constant presence in her life since the adults had given up on teaching the children anything but survival skills.
+
+"Kira," a voice whispered urgently, jolting her out of her reverie. She turned to see Jax, another orphan and one of the few people she trusted. His face was pale and his eyes wide with fear. "You need to come with me, now."
+
+She followed him through the maze-like corridors, her heart pounding in her chest. They arrived at a small, hidden room that served as their makeshift home. Inside, huddled around a flickering screen, were several other children, their faces etched with worry and excitement.
+
+"Look," Jax said, pointing to the screen. It displayed a grainy image of a man in tattered clothing, his face half-hidden by a wild beard. "He says he knows how to fix the engines."
+
+Kira's eyes widened in disbelief. The engines had been dead for as long as she could remember, their failure sealing their fate as interstellar castaways. "Who is he?" she asked, her voice barely above a whisper.
+
+"They call him the Mechanic," one of the older girls replied. "He used to work in engineering before...before everything fell apart."
+
+The man on the screen continued his frantic plea, detailing his plan to restore power and steer the ship towards a habitable planet he claimed was within reach. Kira felt a spark of hope ignite within her, but it was quickly doused by the skepticism of the others.
+
+"It's just another one of their lies," spat a boy named Taro. "They'll say anything to get us to do their dirty work."
+
+Jax rounded on him, his fists clenched. "This is our chance, Taro! We can't just give up!"
+
+The argument raged on, but Kira tuned it out, her thoughts racing. She knew the risks of trusting an adult, especially one who claimed to have access to forbidden knowledge. But what if he was telling the truth? What if they could find a new home and start over?
+
+As she watched the debate unfold, she made up her mind. She would seek out this Mechanic and offer him her help, no matter the cost. It was a decision born of desperation, but also of a stubborn refusal to accept the bleak future that lay before them.
+
+And so, as the other children slept fitfully around her, Kira slipped out into the dark corridors once more, determined to find the man who might hold the key to their salvation or doom. The ship groaned and creaked around her, a constant reminder of the fragile existence they all clung to. But she pressed on, driven by an unyielding will to survive and the faintest glimmer of hope that burned within her heart.
+
+As she navigated the treacherous path towards engineering, she couldn't help but wonder what awaited her in the depths of the ship. Would she find a savior or a madman? And more importantly, would she be able to make it back alive?
+
+</details>
+
+<details> <summary>Click to see spoiler</summary>
+
+### USER
+Write me the opening chapter of a dark and gritty Sci-fi trilogy in the style of Frank Herbert and James S. A. Corey. Use third person personal and feature internal monologues of the characters. The POV character for chapter 1 is an astronaut living on a space station orbiting the earth. The day starts off normally, but then him the others notice the mushroom clouds and they have to face inevitability of the situation they are in.
+
+### ASSISTANT
+Chapter 1: Ashes of Exodus
+
+The cold embrace of space enveloped the station like a lover's caress, its infinite blackness punctuated only by the distant twinkle of stars and the ever-present glow of Earth below. Captain Marcus Kane floated through the dimly lit corridors, his magnetic boots barely whispering against the metal floor as he made his way to the observation deck. The daily routine had become a meditative ritual for him, a chance to clear his mind before the cacophony of the day's work began.
+
+As he entered the room, the sight that greeted him never failed to take his breath away. Earth, a swirling marble of blues and greens, hanging in the void like an irreplaceable jewel. He couldn't help but feel a pang of longing for its familiar embrace, for the weight of gravity that he had left behind so many years ago.
+
+Marcus settled into his favorite spot by the window, the worn leather of the seat molded to his body like an old friend. He closed his eyes and let the silence wash over him, the only sound the soft hum of the station's life support systems. It was in these moments that he felt truly alive, connected to something greater than himself.
+
+But today, the silence was shattered by a chilling alarm, its shrill wail piercing the tranquility like a knife through glass. His eyes snapped open as his heart began to race, adrenaline coursing through his veins. He knew that sound all too well; it was the emergency alert for an incoming transmission from Earth.
+
+He launched himself towards the comms console, fingers flying over the keys as he tried to make sense of the garbled message. The voice on the other end was frantic, barely coherent through the static. "Multiple...detonations...global catastrophe..." were the only words he could decipher before the signal died completely.
+
+Marcus's mind raced as he tried to process what he had just heard. It couldn't be true, it couldn't be happening. Not again. He quickly activated the external cameras, his stomach twisting into knots as he waited for the feed to come online.
+
+And then he saw them: mushroom clouds, blooming like grotesque flowers across the planet's surface. Too many to count, their plumes of smoke and ash reaching up towards the heavens in a silent scream of despair. The sight was both beautiful and horrifying, a testament to humanity's capacity for destruction on an unimaginable scale.
+
+His thoughts were interrupted by the sound of footsteps behind him as the rest of the crew floated into the room, drawn by the alarm. Their faces mirrored his own shock and disbelief as they stared at the monitors, their voices a cacophony of whispers and gasps.
+
+"What...what is that?" asked Dr. Amelia Chen, her voice trembling with fear.
+
+Marcus didn't answer; he couldn't find the words. Instead, he simply pointed at the screen, his hand shaking slightly.
+
+Engineer Jake Taylor was the first to break the silence. "Nuclear war," he said, his voice flat and emotionless. "It's finally happened."
+
+The others looked at him in horror, but Marcus knew he was right. There could be no other explanation for such devastation. He felt a cold weight settle in the pit of his stomach as the reality of their situation began to sink in. They were alone, adrift in the vastness of space with no hope of return.
+
+As the implications of what they had just witnessed set in, the crew fell into an uneasy silence, each lost in their own thoughts. Marcus couldn't help but think about his wife and daughter back home, wondering if they were safe or if they too had been consumed by the flames. He knew it was a futile exercise, but he couldn't stop himself from hoping against hope that somehow, someway, they had survived.
+
+But as the minutes ticked by and no further communication came from Earth, that hope began to fade like a dying ember. They were truly alone now, the last remnants of humanity clinging to life on this tiny outpost in the void.
+
+He turned to face his crew, their faces etched with fear and uncertainty. "We need to come up with a plan," he said, his voice steady despite the turmoil raging within him. "We can't just sit here and wait for...for whatever comes next."
+
+Amelia nodded, her eyes hardening with determination. "I'll start running diagnostics on our life support systems, see how long we can last up here."
+
+Jake followed suit, his hands already moving to the controls of the station's mainframe. "I'll try to establish contact with any other surviving outposts or spacecraft."
+
+Marcus nodded, grateful for their resolve in the face of such overwhelming odds. He knew that they were all thinking the same thing: that this could very well be the end of everything they had ever known. But he also knew that they couldn't give up, not yet.
+
+As he watched them work, his mind drifted back to the message from Earth, those final desperate words echoing in his head like a funeral dirge. He couldn't shake the feeling that there was something more, some hidden meaning or clue that would explain what had happened.
+
+And then it hit him: the timing of the detonations, the pattern of the blasts. It wasn't random; it was deliberate, almost...calculated. But who would do such a thing? And why?
+
+The questions swirled in his mind like a storm, each one more unsettling than the last. He knew that they needed answers, and fast. Because if this was an act of war, then their isolation might not be as secure as they thought.
+
+He pushed himself away from the console, his decision made. "I'm going to suit up," he said, his voice firm. "We need to get a closer look."
+
+The others stared at him in disbelief, but he didn't waver. This was his duty as captain, to protect his crew and find out the truth no matter how terrible it might be.
+
+As he floated towards the airlock, Marcus couldn't help but feel a sense of dread creeping up on him like a shadow. He knew that what he was about to see would change everything, that there was no going back once he stepped outside and gazed upon the ashes of humanity's final stand.
+
+But he also felt something else: a burning anger, a fierce determination to uncover the truth and make those responsible pay for their crimes against humanity. Whatever awaited them out there, they would face it together, as one.
+
+He closed his eyes and took a deep breath, steeling himself for what was to come. And then, with a quiet prayer on his lips, he opened the airlock and stepped into the void.
+
+</details>
+
+<details> <summary>Click to see spoiler</summary>
+
+### USER
+Write me the opening chapter of a dark and gritty Sci-fi trilogy in the style of Frank Herbert and James S. A. Corey. Use third person personal and feature internal monologues of the characters. The POV character for chapter 1 is a worker constructing a biodome when a terrible accident happens. Make the story very dark; no happy ending here...
+
+### ASSISTANT
+Chapter 1: The Biodome
+
+The air was thick with the scent of sweat and burnt metal as Kaelen, a seasoned construction worker, tightened the last bolt on the massive irrigation system. He wiped his brow with the back of his gloved hand, leaving behind a smear of grease that glistened under the harsh artificial lights. The hum of machinery and distant shouts echoed through the cavernous space, a cacophony that had become as familiar to him as his own heartbeat over the years spent building biodomes on this desolate planet.
+
+Kaelen's thoughts drifted to his family back on Earth, their faces faded like old photographs in his mind. He wondered if they ever thought about him, or if he was just another ghost haunting the fringes of their memories. The company had promised them a better life, but it came at a steep price: years of backbreaking labor on an alien world, far from everything they'd ever known.
+
+"Hey, Kael!" A voice cut through his reverie, jolting him back to reality. It was Tamsin, his foreman, her face hidden behind a tinted visor. "We need you up top! There's an issue with the atmospheric seal."
+
+He nodded curtly and began the long climb up the scaffolding, each rung biting into his calloused hands. As he ascended, Kaelen couldn't help but marvel at the sheer scale of their creation: a vast dome of steel and glass that would one day be teeming with life, a self-sustaining ecosystem in the heart of this barren wasteland.
+
+But today was not that day. Today, it was just another tomb waiting to be sealed.
+
+As he reached the top, Kaelen could see the problem immediately: a small fissure had formed along one of the joints, spewing precious oxygen into the void beyond. He cursed under his breath; they were already behind schedule and over budget. Another delay would mean another round of demerits, another month's pay docked.
+
+"What do you think?" Tamsin asked, her voice crackling through his earpiece. "Can we patch it up or do we need to call in the engineers?"
+
+Kaelen hesitated, running his fingers along the jagged edge of the tear. It was larger than he'd initially thought, and growing by the second. He could feel the cold tendrils of vacuum reaching out to claim him, whispering promises of oblivion.
+
+"I... I don't know," he admitted, his voice heavy with dread. "It doesn't look good."
+
+Tamsin swore colorfully and turned away, barking orders into her comm unit. Kaelen watched as workers scrambled to gather tools and materials, their movements frantic and disorganized. He knew they were all thinking the same thing: if they couldn't fix this, they were dead.
+
+The air around them grew colder, thinner, as the oxygen continued to escape. Kaelen's lungs burned with every breath, his vision swimming at the edges. He fumbled with the patch kit, his hands shaking uncontrollably. This was it; this was how he would die, millions of miles from home, in service to a corporation that saw him as nothing more than a replaceable cog in their grand machine.
+
+"Hurry up!" Tamsin shouted over the growing din. "We're losing pressure fast!"
+
+Kaelen's heart pounded in his chest like a sledgehammer, drowning out all other sound. He could feel the panic rising within him, threatening to consume him whole. But he couldn't afford to give in; not now, not when so much was at stake.
+
+With trembling hands, he applied the sealant and pressed the patch into place. For a moment, it seemed to hold... but then, with a sickening lurch, the fissure widened, swallowing the feeble attempt whole. The wind howled around them like a ravenous beast, tearing at their suits, trying to pull them apart atom by atom.
+
+"Abort!" Tamsin screamed, her voice barely audible over the roar. "Everyone get out now!"
+
+But it was too late. The dome shuddered beneath their feet, groaning in protest as the atmosphere inside rushed to equalize with the void outside. Kaelen felt himself being lifted off the ground, his boots scrabbling for purchase on the slick metal surface. He reached out, desperate to grab onto something - anything - but found only emptiness.
+
+And then, as suddenly as it had begun, there was silence. A deafening, suffocating silence that pressed in on him from all sides. His vision went dark, and he knew no more.
+
+When Kaelen awoke, he was lying on the cold floor of the dome, his body wracked with pain. He tried to move, but found himself held fast by twisted metal and shattered glass. Panic surged through him once again as he realized that his suit had been breached; he could feel the icy chill of vacuum seeping into his very bones.
+
+Through the haze of agony, he became aware of movement nearby. Tamsin was there, her visor cracked and fogged, struggling to free herself from the wreckage. She looked at him with wide, terrified eyes, her lips moving soundlessly. He knew what she was saying: they were going to die here, alone and forgotten.
+
+Kaelen closed his eyes, willing himself to accept the inevitable. But even as the darkness closed in, he couldn't shake the feeling that this wasn't just an accident - that there were forces at work far beyond their understanding, manipulating them like pawns on a cosmic chessboard.
+
+And then, just when he thought it was all over, he heard it: a faint beeping, growing louder by the second. His eyes snapped open to see a small drone hovering above them, its lights flashing urgently. It was one of the company's rescue bots, sent to assess the damage and retrieve any survivors.
+
+But there would be no salvation for Kaelen or Tamsin. Their suits were too damaged, their bodies too far gone. As the drone's camera lens bore down on him, he could only manage a weak, bitter smile.
+
+"Tell my family... tell them I'm sorry," he croaked, his voice barely audible even to himself. Tamsin reached out a gloved hand, her fingers brushing against his own in a final gesture of solidarity.
+
+And then, as the darkness claimed him once more, Kaelen knew that this was not the end of their story - but rather, the beginning of something far more sinister. Something that would change the course of human history forever...
+
+
+</details>
+
+<details> <summary>Click to see spoiler</summary>
+
+### USER
+Write me the opening chapter of a dark and gritty Sci-fi trilogy in the style of Frank Herbert and James S. A. Corey. Use third person personal and feature internal monologues of the characters. The POV character for chapter 1 is manning a listening station in deep space. What he hears over the radio chills him to the bone.
+
+### ASSISTANT
+Chapter 1 - Whispers from the Void
+
+The silence of deep space was like an old friend to Captain Alistair Reynolds, a constant companion that had accompanied him through countless missions and lonely nights at the helm of the listening station. But today, it felt more like a suffocating shroud, heavy with unspoken secrets and foreboding. He sat in his chair, fingers drumming impatiently on the console as he scanned the endless stream of data pouring in from the far reaches of the cosmos.
+
+His thoughts drifted to home, to the warmth of his wife's embrace and the laughter of their children playing in the garden under the twin suns of Proxima Centauri. It had been years since he last felt that warmth, since he last heard those laughs. The ache was always there, a dull throb that pulsed in time with his heartbeat, but today it seemed to echo through the cold metal halls of the station like a mournful dirge.
+
+A sudden blip on the screen snapped him back to reality. He leaned forward, eyes narrowing as he studied the readout. It was faint, barely more than a whisper against the static, but it was there - a signal, human in origin and heavily encrypted. His heart raced as he keyed in the decryption sequence, his mind already racing ahead to the possibilities of what this could mean.
+
+The message unscrambled, revealing a frantic voice, barely audible over the crackle of interference. "This is the UES Normandy, requesting immediate assistance... coordinates attached... under attack by unknown forces... God help us..." The transmission cut out abruptly, leaving only the empty hiss of static in its wake.
+
+Alistair's blood ran cold as he stared at the screen, the weight of the silence pressing down on him like a physical force. He knew that ship, had served with her captain back during the Martian uprising. They were old friends, bound by shared battles and the scars they bore from them. And now she was out there, alone and in danger.
+
+He didn't hesitate. His fingers flew over the console, sending out an emergency beacon to the nearest fleet. But he knew it would take time for help to arrive, time that the Normandy might not have. He had to do something now.
+
+As he prepared to launch a probe towards the coordinates, his mind filled with images of burning ships and desperate faces. He could almost hear the screams of the dying, echoing through the void like ghosts from his past. It was a sound that haunted him still, one he had hoped never to hear again.
+
+But duty called, and Alistair was nothing if not a soldier. He took a deep breath, steadying himself against the tide of fear and doubt that threatened to overwhelm him. This was his job, his purpose - to listen, to bear witness, and when necessary, to act.
+
+The probe shot out into the darkness, its tiny form swallowed up by the vastness of space. He watched it go, feeling a strange sense of detachment as if he were watching someone else's life play out before him. And perhaps in some ways, he was. For all his years in service, this was the first time he had ever been truly alone, cut off from the rest of humanity by light-years and the cold indifference of the universe.
+
+As the minutes ticked by, Alistair found himself slipping into a half-trance, his thoughts drifting back to happier times. He remembered the first time he had held his newborn son, the tiny fingers curling around his own as if trying to hold on for dear life. He remembered the taste of real Earth coffee, rich and bitter, shared with his wife under a sky full of stars that seemed close enough to touch.
+
+But those memories were distant now, fading like echoes in the void. All he had was this station, this endless vigil, and the hope that one day, he might make it back home.
+
+The radio crackled to life again, jolting him out of his reverie. It was the probe, transmitting data back from the edge of nowhere. He braced himself for what he would find, knowing that it could change everything.
+
+What greeted him on the screen was worse than anything he could have imagined. The Normandy was there, alright - or rather, what was left of her. She drifted through space like a broken toy, her hull breached and venting atmosphere into the cold void. There were no signs of life, no distress signals, nothing but silence.
+
+Alistair felt a cold knot form in his stomach as he took in the wreckage. This wasn't just any ship; this was his friend's ship, her crew now lost to the void. And the attackers... whoever or whatever they were, they had left no trace behind.
+
+He sat back in his chair, the weight of it all settling heavily upon him. He knew what he had to do next - file a report, alert command, and wait for further instructions. But as he stared at the lifeless husk that was once the Normandy, he couldn't shake the feeling that something far greater than himself was at work here.
+
+Something dark and terrible had come calling, whispering its secrets through the stars. And now it was his turn to listen, to bear witness, and perhaps, if he was lucky, to survive long enough to tell the tale.
+
+</details>
+
+## Miscellaneous stories
+
+<details> <summary>Click to see spoiler</summary>
+
+### USER
+Write me the opening chapter of a dark and gritty post-apocalyptic novel in the style of Cormac McCarthy. Use third person personal and feature internal monologues of the characters. The POV character for chapter 1 is a technician in a nuclear bunker 18 months after the war. The 12 inhabitants of the bunker have been expecting to start to be able to leave soon, but it has just been discovered that at least where they are,  salted cobalt bombs were used. It's clear now that either all 12 will die when the resources run out and their is barely enough for 6 to make it to 5 years and have any hope of leaving. After 18 months of calm everything breaks lose today.
+
+### ASSISTANT
+In the dim light of the bunker, the technician sat hunched over his console, fingers dancing across the keys with a practiced urgency. The air was thick with the hum of machinery and the stench of sweat and fear. He had been down here for what felt like an eternity, but the digital clock on the wall insisted it had only been eighteen months since the world above had turned to ash.
+
+His name was Samuel, or at least that's what they called him now. In another life, he had been a software engineer, designing algorithms for self-driving cars and smart homes. Now, he was responsible for keeping twelve souls alive in this underground tomb, their last bastion against the desolation above. He glanced up at the monitor, the green glow illuminating his haggard face. The readings were clear: salted cobalt bombs had been used.
+
+The thought sent a shiver down his spine. They had all heard the rumors, of course, but they had clung to hope like a drowning man to driftwood. Hope that the war hadn't been as bad as they feared, that the surface would be habitable again soon. But now, the truth was undeniable. The world outside was dead, and it would remain so for generations.
+
+Samuel closed his eyes, trying to block out the images of a scorched earth, devoid of life. He could hear the others in the background, their voices a low murmur as they went about their daily tasks. They didn't know yet. How could he tell them? How could he be the one to snuff out the last ember of hope that had kept them going for so long?
+
+He took a deep breath and stood up, his joints creaking in protest. He made his way through the narrow corridors, past the rows of bunks where some slept fitfully, their dreams haunted by memories of a world they would never see again. Others were awake, their faces etched with lines of worry and despair. They looked up as he passed, but he couldn't meet their gazes.
+
+He reached the command center, where Captain Reynolds was poring over maps and reports. The man looked up as Samuel entered, his eyes heavy with exhaustion. "What is it?" he asked, his voice gruff.
+
+Samuel hesitated for a moment before speaking. "Sir, I have some... troubling news."
+
+The captain's expression didn't change, but Samuel could see the tension in his jaw. He had been expecting this, too. "Go on," he said simply.
+
+"The radiation readings... they're off the charts. It's cobalt-60. The half-life is over five years."
+
+Reynolds let out a slow breath, his eyes never leaving Samuel's face. "And our supplies?"
+
+"We have enough for six, maybe seven if we ration carefully. But not twelve."
+
+The room seemed to shrink around them as the weight of their situation settled in. The captain rubbed his temples, his thoughts racing. They had always known that their time in the bunker was limited, but they had been so close. So very close.
+
+"We'll need to make a decision," he said finally, his voice barely above a whisper. "Who stays, and who goes."
+
+Samuel felt a knot form in his stomach. He knew what that meant. It was survival of the fittest down here now, and there were those among them who would do anything to ensure their own survival.
+
+As he made his way back to his console, he couldn't help but think about the world above. The trees that would never grow again, the birds that would never sing. He thought of his wife and daughter, their faces fading like photographs left in the sun. They had been lucky, they said, to have made it into the bunker. But now, he wasn't so sure.
+
+In the mess hall, the atmosphere was tense. Whispers and hushed conversations filled the air as people tried to make sense of what they had just heard. Samuel sat alone at a table, staring blankly at his food. He couldn't eat. Not now.
+
+He felt a hand on his shoulder and looked up to see Maria, the doctor. Her eyes were red-rimmed, but her voice was steady. "We need to talk," she said, guiding him towards the infirmary.
+
+Once inside, she closed the door behind them and leaned against it, her body trembling. "What are we going to do?" she asked, her voice cracking.
+
+Samuel shook his head. "I don't know."
+
+"We can't just let six of us die," she said, her voice rising in panic. "There has to be another way."
+
+He looked at her, at the desperation etched on her face, and felt a flicker of anger. "What do you suggest? We all hold hands and sing Kumbaya while we starve to death?"
+
+Maria's eyes flashed with anger, but she quickly composed herself. "No," she said softly. "But we can't just give up."
+
+Samuel sighed and ran a hand through his greasy hair. "I'm not giving up," he said. "I'm just being realistic."
+
+She looked at him for a long moment before nodding. "You're right," she said, her voice barely audible. "We need to be realistic."
+
+They sat in silence for a while, each lost in their own thoughts. Then, Maria spoke up again. "There is one option," she said hesitantly. "But it's... drastic."
+
+Samuel raised an eyebrow. "What?"
+
+"We could... we could draw straws," she said, her voice barely above a whisper. "Choose six people at random to leave the bunker and take their chances on the surface."
+
+He stared at her in disbelief. "You can't be serious."
+
+"It's not ideal," she admitted. "But it's better than just letting them die down here."
+
+Samuel shook his head, his mind reeling. He couldn't fathom the thought of sending people out into that wasteland, knowing they would likely never return. But what other choice did they have?
+
+As he sat there, the weight of their decision pressing down on him like a leaden shroud, he heard a commotion outside. Shouting, followed by the sound of scuffling feet and something heavy being dragged across the floor. He exchanged a worried glance with Maria before rushing out into the corridor.
+
+What he saw made his blood run cold. A group of men had cornered one of the younger women, their faces twisted with rage and desperation. They were arguing over who would get to leave the bunker, who would get a chance at life. Fists flew, and soon, the sound of gunfire echoed through the halls.
+
+Samuel stood there, frozen in place as chaos erupted around him. This was it. The end of everything they had worked so hard to preserve. He could feel the darkness closing in, suffocating him, as he realized that their last hope for survival had just been shattered like glass under a bootheel.
+
+And all he could do was watch as the world above claimed them, one by one.
+
+</details>
+
+<details> <summary>Click to see spoiler</summary>
+
+### USER
+Write me the opening chapter of a historical mystery novel in the style of Arturo Pérez-Reverte and Umberto Eco. The story starts off in California during the 1948 Gold Rush, before moving to London in the mid 1970s. There should be a mysterious 'occult' item that connects these two time periods.
+
+### ASSISTANT
+ Chapter One: The Golden Veil
+
+The year was 1848, and California was a land of dreams and desperation. Men from all corners of the world had flocked to its golden shores, lured by the promise of wealth beyond their wildest imaginations. They came with pickaxes and pans, with hope in their hearts and greed in their eyes, ready to tear apart the earth itself in search of fortune.
+
+In the midst of this frenzy stood a solitary figure, a man who seemed out of place amidst the chaos. He was tall and lean, with a face that bore the lines of a thousand stories. His clothes were simple but well-made, his boots worn from years of travel. He moved with an air of quiet authority, as if he belonged to another time entirely.
+
+His name was Alistair Blackwood, and he had come to California not for gold, but for something far more valuable: knowledge. A scholar by trade and an adventurer at heart, Blackwood had spent his life chasing after ancient texts and forgotten lore, seeking to unravel the secrets of the universe. And now, he believed he was on the verge of a discovery that would change everything.
+
+Rumors had reached him of a strange artifact, said to have been found deep within the Sierra Nevada mountains. It was a small, intricately carved box made of an unknown metal, its surface etched with symbols that defied translation. Those who claimed to have seen it spoke in hushed tones of its otherworldly beauty and the eerie sense of power that seemed to emanate from within.
+
+Blackwood had tracked the rumors to a dusty saloon in Sacramento, where he hoped to find answers among the grizzled miners who frequented the place. As he pushed open the swinging doors, the din of voices and clinking glasses washed over him like a wave. He scanned the room, his gaze settling on a group of men huddled around a table in the corner.
+
+One look at their faces told him they were the ones he sought: sun-weathered and unshaven, their eyes glinting with a mixture of excitement and fear as they whispered amongst themselves. He approached them slowly, aware that he was an outsider in this rough-and-tumble world.
+
+"Gentlemen," he said, his voice low and cultured, "I couldn't help but overhear your conversation. Might I be so bold as to ask what has you all so...animated?"
+
+The men exchanged wary glances before one of them spoke up. "You ain't from around here, are ya?" he drawled, eyeing Blackwood's fine clothes with suspicion.
+
+"No," Blackwood admitted, "I am not. But I have traveled far and wide in search of knowledge, and I believe you may possess something that could be of great interest to me."
+
+He reached into his pocket and produced a small leather pouch, which he placed on the table with a soft thud. The men's eyes widened as they saw the glint of gold within.
+
+"I understand there is an object - a box, perhaps? - that has recently come into your possession. I would be willing to pay handsomely for any information you might have about it."
+
+The miners looked at each other, then back at Blackwood. Finally, the one who had spoken before nodded slowly. "We might know somethin' 'bout that," he said, his voice dropping to a conspiratorial whisper. "But it ain't no ordinary box."
+
+As they began to tell their tale, the saloon faded away around them, replaced by images of dark caverns and glittering treasure. Blackwood leaned forward, his heart pounding with anticipation. This was it - the moment he had been waiting for.
+
+The box, they said, had been found buried beneath a waterfall, hidden in a cave that seemed to defy all natural laws. It was guarded by strange creatures unlike anything any of them had ever seen: half-man, half-beast, with eyes that glowed like embers in the darkness.
+
+But the greatest mystery of all lay within the box itself. For when they opened it, they found not gold or jewels, but a single sheet of parchment, yellowed with age and covered in writing that none of them could decipher.
+
+Blackwood's pulse quickened as he listened. This was more than just another piece of occult nonsense; this was the real thing. He knew it in his bones.
+
+"I must see this box for myself," he said, his voice barely above a whisper. "Take me to it."
+
+The miners exchanged uneasy glances before nodding their assent. They led him out of the saloon and into the night, down winding streets and through shadowy alleyways until they reached a nondescript building on the edge of town. Inside, they descended a rickety staircase to a dimly lit basement filled with crates and barrels.
+
+There, in the center of the room, sat the object of his obsession: a small, unassuming box that seemed to hum with energy. Blackwood reached out a trembling hand to touch it, feeling the power coursing through him like electricity.
+
+As he did so, the world around him shifted, and suddenly he was no longer in a dingy basement in Sacramento. He stood instead in a grand library, its shelves groaning under the weight of countless tomes and scrolls. A fire crackled in the hearth, casting flickering shadows on the walls.
+
+A figure emerged from the gloom, cloaked in darkness save for two piercing eyes that seemed to bore into his very soul. "You have found it," the voice said, deep and resonant. "The key to unlocking the secrets of the universe."
+
+Blackwood stared at the apparition, unable to speak. He knew he should be afraid, but all he felt was awe.
+
+"But be warned," the figure continued, "for with great power comes great responsibility. The knowledge contained within this box is not meant for mortal minds."
+
+And then, just as suddenly as it had appeared, the vision vanished, leaving Blackwood alone once more in the dimly lit room. He stared at the box, his mind racing. What did it all mean?
+
+As he pondered this question, a sudden commotion erupted upstairs. Shouts and gunfire filled the air, followed by the sound of heavy footsteps on the staircase. The miners had betrayed him!
+
+He snatched up the box and fled into the night, his heart pounding in his chest. He knew he couldn't stay in California - not now that others were after the artifact. No, he would have to take it far away, to a place where its secrets could be studied in safety.
+
+And so began a journey that would span continents and decades, from the wild frontier of the Gold Rush to the foggy streets of Victorian London. For Alistair Blackwood had stumbled upon something much greater than mere treasure; he held in his hands the key to unlocking the very fabric of reality itself.
+
+But little did he know that the true mystery was only just beginning...
+
+</details>
+
+<details> <summary>Click to see spoiler</summary>
+
+### USER
+Write me the opening chapter of a dark and gritty historical novel set during the battle of the Bulge. Write in first person. The POV character for Chapter 1 is a young German officer trying to carry his wounded commander back to the deep defensive line after the bunker he was in was overrun. He should have a flashback to the moment it was overrun during the middle of the story. The story should not end well for either of them.
+
+### ASSISTANT
+Chapter 1
+
+The cold bit into my bones as I trudged through the snow, each step a labored effort. My breath came out in ragged puffs, clouding the air around me. In my arms, I cradled the weight of my world - my commander, Hauptmann Müller, his body limp and heavy with pain. His eyes were closed, but I could hear the shallow rasp of each breath he took, a testament to his will to live.
+
+The forest around us was a maze of shadows and death, the trees standing like skeletal sentinels against the moonlit sky. The silence was deafening, broken only by the distant rumble of artillery and the occasional crack of a rifle shot. It was a cruel irony that the same snow that muffled our footsteps also betrayed the presence of the enemy, their tracks glowing like phosphorescent snakes in the pale light.
+
+I stumbled, my legs threatening to give way under the strain. Hauptmann Müller groaned, his hand clutching at my coat. "Keep moving, Leutnant," he whispered, his voice barely audible. "We must reach the defensive line."
+
+I nodded, gritting my teeth as I adjusted my grip on him. The pain in my arms and shoulders was a constant companion now, but it was nothing compared to the fear that gnawed at my gut. We were alone, cut off from our unit during the chaos of the American assault. The bunker we had been holed up in was now a tomb for the men who had trusted us to lead them.
+
+A flash of memory seared through my mind, taking me back to that fateful moment when it all went wrong. The thunderous roar of explosions, the earth shaking beneath our feet as if the very foundations of hell were breaking loose. The screams of men, the acrid smell of smoke and cordite, the taste of blood in my mouth.
+
+I remembered the look on Müller's face when he realized what was happening - a mixture of disbelief and determination. He had barked orders, trying to rally our troops, but it was too late. The Americans were upon us, their numbers overwhelming. I saw him take a bullet to the leg, his face contorting in agony as he fell. And then there was nothing but chaos and darkness.
+
+When I came to, the bunker was silent except for the moans of the dying. The air was thick with smoke, making it hard to breathe. I found Müller slumped against a wall, his uniform soaked in blood. He looked up at me, his eyes glassy with pain but still burning with that same fierce determination. "We have to go," he said, gripping my arm. "They're coming."
+
+And so we had fled into the night, leaving behind the wreckage of our command post and the bodies of our comrades. Now, hours later, we were still stumbling through the forest, searching for safety that seemed to recede with every step.
+
+I could feel my strength ebbing away, my legs turning to lead. But I couldn't stop, not now. Not when we were so close. The deep defensive line was our only hope, a thin red line that stood between us and annihilation. If we could just make it there...
+
+But fate is a cruel mistress, and she had other plans for us. As we staggered out of the trees and into a small clearing, I saw them - a patrol of American soldiers, their silhouettes stark against the snow. They spotted us at the same time, their rifles swinging around to point in our direction.
+
+"Halt!" one of them yelled, his voice harsh and commanding. "Hands up!"
+
+I froze, my heart pounding in my chest. Müller's grip on me tightened, his breath coming in short gasps. I knew what he was thinking - we couldn't surrender, not like this. We were too valuable, too close to the front lines. They would shoot us or take us prisoner, and either way, it would be a death sentence for him.
+
+"Run," he whispered, his voice barely audible. "Leave me."
+
+I shook my head, tears stinging my eyes. I couldn't do that. I wouldn't. He was my commander, my friend. I owed him everything.
+
+But before I could make a move, the air was filled with the sound of gunfire. Müller jerked in my arms, a wet gurgle escaping his lips as he slumped against me. I stared down at him in disbelief, feeling the warmth of his blood soaking through my coat.
+
+"Nein," I whispered, my voice choked with grief and rage. "Nein!"
+
+I fell to my knees, cradling his lifeless body as the world around me spun out of control. The Americans were closing in, their shouts growing louder. I knew it was over - for both of us.
+
+With a final, desperate cry, I raised my pistol and fired into the darkness, hoping to take at least one of them with me. But my aim was wild, my strength gone. The last thing I saw was a flash of light, followed by an explosion of pain in my chest. And then there was nothing but blackness.
+
+As I slipped away, I thought of home - of my mother's warm embrace, of the laughter of my little sister. And I knew that I would never see them again. This frozen hellhole would be my grave, and Hauptmann Müller's sacrifice would be forgotten by all but me.
+
+But in that moment, as death claimed me, I found a strange sort of peace. We had fought for our Fatherland until the very end, and we had done so with honor. And in the grand tapestry of history, perhaps that was all that mattered.
+
+
+</details>
+
+<details> <summary>Click to see spoiler</summary>
+
+### USER
+Write me a short story about the fictional character of Anton Chigurh. It should be written in third person personal and feature internal monologues of his deranged world view. The time period is around 2 years before the events in Cormac McCarthy's 2005 novel 'No Country for Old Men'. It should be set in Mexico, be *very* dark, show Anton's still developing obsession with "chance" and feature a grenade. The story should start with him waiting in a bar for instructions on the "job" he is to perform.
+
+### ASSISTANT
+In the dimly lit corner of a nondescript Mexican cantina, Anton Chigurh sat motionless, his eyes scanning the room like a predator assessing its prey. The air was thick with the smell of stale cigarette smoke and cheap tequila, but he remained unfazed, his senses heightened, attuned to every sound, every movement around him. He nursed a glass of water, the condensation beading on its surface like droplets of sweat on cold steel.
+
+His mind wandered, as it often did, to the concept of chance. The randomness of life and death fascinated him, the idea that one's fate could hinge on something as simple as a coin flip or the roll of dice. He believed in the purity of such decisions, untainted by human emotion or prejudice. It was a philosophy he had embraced wholeheartedly, and it had served him well in his line of work.
+
+A fly buzzed around his head, its tiny wings beating an erratic rhythm against the stillness of the room. He watched it with mild interest, wondering if its life would end here, on this very spot, or if it would continue its meaningless existence elsewhere. The thought brought a small, cruel smile to his lips.
+
+The bartender, a grizzled old man with a face like leather, eyed him warily from across the room. He knew better than to engage in conversation with this stranger, who had entered his establishment an hour ago and hadn't spoken a word since. There was something about him that made the hairs on the back of his neck stand up, something cold and deadly lurking just beneath the surface.
+
+Chigurh's thoughts were interrupted by the sound of the door creaking open. A man in a cheap suit entered, looking around nervously before making his way towards him. He slid into the seat across from Chigurh, who continued to stare straight ahead, as if he hadn't noticed the new arrival.
+
+"You're late," Chigurh said finally, his voice low and gravelly.
+
+The man in the suit swallowed hard, adjusting his tie. "I apologize. Traffic."
+
+Chigurh didn't respond, his eyes still fixed on some distant point. The man fidgeted, reaching into his pocket to retrieve a small envelope. He slid it across the table, and Chigurh picked it up without looking at him, tearing it open with a single, precise movement.
+
+Inside was a photograph of a man, along with an address scrawled on a piece of paper. He studied the image for a moment, committing every detail to memory before slipping it back into the envelope and sliding it into his own pocket.
+
+"You know what needs to be done," the man in the suit said, his voice barely above a whisper.
+
+Chigurh nodded once, his mind already turning to the task at hand. He stood up, leaving a few crumpled bills on the table for the water he hadn't touched. As he walked towards the door, he could feel the weight of the grenade in his other pocket, its cool metal surface pressing against his thigh like a lover's caress.
+
+Outside, the heat of the day was oppressive, but Chigurh barely registered it as he climbed into his car and started the engine. He drove through the dusty streets, his thoughts consumed by the upcoming job. The man in the photograph had a wife, two kids. It didn't matter. They were all just pieces on a board, pawns to be moved or removed as necessary.
+
+He arrived at the address just as the sun was beginning to set, casting long shadows across the dilapidated building. He sat in his car for several minutes, watching the comings and goings of the neighborhood, waiting for the right moment. When it came, he slipped out of the vehicle and approached the door with a sense of purpose.
+
+Inside, he could hear laughter and music, the sounds of a family enjoying their evening together. He smiled to himself as he pulled the grenade from his pocket, feeling its weight in his hand. This was what he lived for: the moment when chance decided who would live and who would die.
+
+He took a deep breath, savoring the anticipation, before pulling the pin with a satisfying click. He tossed it into the room, not bothering to wait for the explosion as he turned and walked away. The screams that followed were like music to his ears, a symphony of chaos and destruction.
+
+As he drove off into the night, Chigurh couldn't help but feel a sense of satisfaction. Another job well done, another life ended by the whims of fate. He reached into his pocket and pulled out a coin, flipping it idly between his fingers as he considered his next move.
+
+Heads or tails? Life or death? It was all the same to him. The world was a cruel place, and he was just its instrument, meting out justice in the only way he knew how: with cold, calculated precision. And if some people happened to get caught in the crossfire... well, that was just the luck of the draw.
+
+</details>
+
+Big thanks to: @sophosympatheia for working out the merge pattern, @Sao10K for creating Euryale and WinterGoddess, and @chargoddard for writing [Mergekit](https://github.com/arcee-ai/mergekit)!

config.json

@@ -0,0 +1,39 @@
+{
+    "architectures": [
+        "LlamaForCausalLM"
+    ],
+    "attention_bias": false,
+    "attention_dropout": 0.0,
+    "bos_token_id": 1,
+    "eos_token_id": 2,
+    "hidden_act": "silu",
+    "hidden_size": 8192,
+    "initializer_range": 0.02,
+    "intermediate_size": 28672,
+    "max_position_embeddings": 32764,
+    "model_type": "llama",
+    "num_attention_heads": 64,
+    "num_hidden_layers": 80,
+    "num_key_value_heads": 8,
+    "pad_token_id": 0,
+    "pretraining_tp": 1,
+    "rms_norm_eps": 1e-05,
+    "rope_scaling": null,
+    "rope_theta": 1000000,
+    "tie_word_embeddings": false,
+    "torch_dtype": "float16",
+    "transformers_version": "4.39.3",
+    "use_cache": true,
+    "vocab_size": 32000,
+    "quantization_config": {
+        "quant_method": "exl2",
+        "version": "0.0.19",
+        "bits": 4.6,
+        "head_bits": 6,
+        "calibration": {
+            "rows": 100,
+            "length": 2048,
+            "dataset": "(default)"
+        }
+    }
+}

generation_config.json

@@ -0,0 +1,7 @@
+{
+  "_from_model_config": true,
+  "bos_token_id": 1,
+  "eos_token_id": 2,
+  "pad_token_id": 0,
+  "transformers_version": "4.39.3"
+}

mergekit_config.yml

@@ -0,0 +1,48 @@
+name: midnight-miqu-70b
+models:
+  - model: ./miqu-1-70b-sf
+  - model: ./Midnight-Rose-70B-v2.0.3
+base_model: ./miqu-1-70b-sf
+merge_method: slerp
+parameters:
+  t:
+    - value: [0, 0, 0.2, 0.3, 0.4, 0.5, 0.4, 0.3, 0.2, 0, 0]
+  embed_slerp: true
+tokenizer_source: model:miqu-1-70b-sf
+dtype: float16
+---
+name: euryale-miqu-70b
+models:
+  - model: ./miqu-1-70b-sf
+  - model: ./Euryale-1.3-L2-70B
+base_model: ./miqu-1-70b-sf
+merge_method: slerp
+parameters:
+  t:
+    - value: [0, 0, 0.2, 0.3, 0.4, 0.5, 0.4, 0.3, 0.2, 0, 0]
+  embed_slerp: true
+tokenizer_source: model:miqu-1-70b-sf
+dtype: float16
+---
+name: winter-miqu-70b
+models:
+  - model: ./miqu-1-70b-sf
+  - model: ./WinterGoddess-1.4x-70B-L2
+base_model: ./miqu-1-70b-sf
+merge_method: slerp
+parameters:
+  t:
+    - value: [0, 0, 0.2, 0.3, 0.4, 0.5, 0.4, 0.3, 0.2, 0, 0]
+  embed_slerp: true
+tokenizer_source: model:miqu-1-70b-sf
+dtype: float16
+---
+name: dark-miqu-70b
+models:
+  - model: ./miqu-1-70b-sf
+  - model: midnight-miqu-70b
+  - model: euryale-miqu-70b
+  - model: winter-miqu-70b
+base_model: ./miqu-1-70b-sf
+merge_method: model_stock
+dtype: float16

model.safetensors.index.json

@@ -0,0 +1 @@
+{"metadata": {"mergekit_version": "0.0.4.2", "total_size": 137953296384}, "weight_map": {"model.layers.2.mlp.gate_proj.weight": "model-00001-of-00015.safetensors", "model.layers.2.self_attn.o_proj.weight": "model-00001-of-00015.safetensors", "model.layers.2.self_attn.v_proj.weight": "model-00001-of-00015.safetensors", "model.layers.2.self_attn.k_proj.weight": "model-00001-of-00015.safetensors", "model.layers.2.self_attn.q_proj.weight": "model-00001-of-00015.safetensors", "model.layers.1.mlp.down_proj.weight": "model-00001-of-00015.safetensors", "model.layers.1.mlp.gate_proj.weight": "model-00001-of-00015.safetensors", "model.layers.1.mlp.up_proj.weight": "model-00001-of-00015.safetensors", "model.layers.1.post_attention_layernorm.weight": "model-00001-of-00015.safetensors", "model.layers.1.self_attn.o_proj.weight": "model-00001-of-00015.safetensors", "model.layers.1.self_attn.v_proj.weight": "model-00001-of-00015.safetensors", "model.layers.1.self_attn.k_proj.weight": "model-00001-of-00015.safetensors", "model.layers.1.self_attn.q_proj.weight": "model-00001-of-00015.safetensors", "model.layers.1.input_layernorm.weight": "model-00001-of-00015.safetensors", "model.layers.0.mlp.down_proj.weight": "model-00001-of-00015.safetensors", "model.layers.0.mlp.gate_proj.weight": "model-00001-of-00015.safetensors", "model.layers.0.mlp.up_proj.weight": "model-00001-of-00015.safetensors", "model.layers.0.post_attention_layernorm.weight": "model-00001-of-00015.safetensors", "model.layers.0.self_attn.o_proj.weight": "model-00001-of-00015.safetensors", "model.layers.0.self_attn.v_proj.weight": "model-00001-of-00015.safetensors", "model.layers.0.self_attn.k_proj.weight": "model-00001-of-00015.safetensors", "model.layers.0.self_attn.q_proj.weight": "model-00001-of-00015.safetensors", "model.layers.0.input_layernorm.weight": "model-00001-of-00015.safetensors", "model.embed_tokens.weight": "model-00001-of-00015.safetensors", "model.layers.5.self_attn.o_proj.weight": "model-00001-of-00015.safetensors", "model.layers.5.self_attn.v_proj.weight": "model-00001-of-00015.safetensors", "model.layers.5.self_attn.k_proj.weight": "model-00001-of-00015.safetensors", "model.layers.5.self_attn.q_proj.weight": "model-00001-of-00015.safetensors", "model.layers.4.mlp.down_proj.weight": "model-00001-of-00015.safetensors", "model.layers.4.mlp.gate_proj.weight": "model-00001-of-00015.safetensors", "model.layers.4.mlp.up_proj.weight": "model-00001-of-00015.safetensors", "model.layers.4.post_attention_layernorm.weight": "model-00001-of-00015.safetensors", "model.layers.4.self_attn.o_proj.weight": "model-00001-of-00015.safetensors", "model.layers.4.self_attn.v_proj.weight": "model-00001-of-00015.safetensors", "model.layers.4.self_attn.k_proj.weight": "model-00001-of-00015.safetensors", "model.layers.4.self_attn.q_proj.weight": "model-00001-of-00015.safetensors", "model.layers.4.input_layernorm.weight": "model-00001-of-00015.safetensors", "model.layers.3.mlp.down_proj.weight": "model-00001-of-00015.safetensors", "model.layers.3.mlp.gate_proj.weight": "model-00001-of-00015.safetensors", "model.layers.3.mlp.up_proj.weight": "model-00001-of-00015.safetensors", "model.layers.3.post_attention_layernorm.weight": "model-00001-of-00015.safetensors", "model.layers.3.self_attn.o_proj.weight": "model-00001-of-00015.safetensors", "model.layers.3.self_attn.v_proj.weight": "model-00001-of-00015.safetensors", "model.layers.3.self_attn.k_proj.weight": "model-00001-of-00015.safetensors", "model.layers.3.self_attn.q_proj.weight": "model-00001-of-00015.safetensors", "model.layers.3.input_layernorm.weight": "model-00001-of-00015.safetensors", "model.layers.2.mlp.down_proj.weight": "model-00001-of-00015.safetensors", "model.layers.2.mlp.up_proj.weight": "model-00001-of-00015.safetensors", "model.layers.2.post_attention_layernorm.weight": "model-00001-of-00015.safetensors", "model.layers.2.input_layernorm.weight": "model-00001-of-00015.safetensors", "model.layers.8.self_attn.v_proj.weight": "model-00001-of-00015.safetensors", "model.layers.8.self_attn.k_proj.weight": "model-00001-of-00015.safetensors", "model.layers.8.self_attn.q_proj.weight": "model-00001-of-00015.safetensors", "model.layers.7.mlp.down_proj.weight": "model-00002-of-00015.safetensors", "model.layers.7.mlp.gate_proj.weight": "model-00002-of-00015.safetensors", "model.layers.7.mlp.up_proj.weight": "model-00002-of-00015.safetensors", "model.layers.7.post_attention_layernorm.weight": "model-00002-of-00015.safetensors", "model.layers.7.self_attn.o_proj.weight": "model-00002-of-00015.safetensors", "model.layers.7.self_attn.v_proj.weight": "model-00002-of-00015.safetensors", "model.layers.7.self_attn.k_proj.weight": "model-00002-of-00015.safetensors", "model.layers.7.self_attn.q_proj.weight": "model-00002-of-00015.safetensors", "model.layers.7.input_layernorm.weight": "model-00002-of-00015.safetensors", "model.layers.6.mlp.down_proj.weight": "model-00002-of-00015.safetensors", "model.layers.6.mlp.gate_proj.weight": "model-00002-of-00015.safetensors", "model.layers.6.mlp.up_proj.weight": "model-00002-of-00015.safetensors", "model.layers.6.post_attention_layernorm.weight": "model-00002-of-00015.safetensors", "model.layers.6.self_attn.o_proj.weight": "model-00002-of-00015.safetensors", "model.layers.6.self_attn.v_proj.weight": "model-00002-of-00015.safetensors", "model.layers.6.self_attn.k_proj.weight": "model-00002-of-00015.safetensors", "model.layers.6.self_attn.q_proj.weight": "model-00002-of-00015.safetensors", "model.layers.6.input_layernorm.weight": "model-00002-of-00015.safetensors", "model.layers.5.mlp.down_proj.weight": "model-00002-of-00015.safetensors", "model.layers.5.mlp.gate_proj.weight": "model-00002-of-00015.safetensors", "model.layers.5.mlp.up_proj.weight": "model-00002-of-00015.safetensors", "model.layers.5.post_attention_layernorm.weight": "model-00002-of-00015.safetensors", "model.layers.5.input_layernorm.weight": "model-00002-of-00015.safetensors", "model.layers.10.mlp.down_proj.weight": "model-00002-of-00015.safetensors", "model.layers.10.mlp.gate_proj.weight": "model-00002-of-00015.safetensors", "model.layers.10.mlp.up_proj.weight": "model-00002-of-00015.safetensors", "model.layers.10.post_attention_layernorm.weight": "model-00002-of-00015.safetensors", "model.layers.10.self_attn.o_proj.weight": "model-00002-of-00015.safetensors", "model.layers.10.self_attn.v_proj.weight": "model-00002-of-00015.safetensors", "model.layers.10.self_attn.k_proj.weight": "model-00002-of-00015.safetensors", "model.layers.10.self_attn.q_proj.weight": "model-00002-of-00015.safetensors", "model.layers.10.input_layernorm.weight": "model-00002-of-00015.safetensors", "model.layers.9.mlp.down_proj.weight": "model-00002-of-00015.safetensors", "model.layers.9.mlp.gate_proj.weight": "model-00002-of-00015.safetensors", "model.layers.9.mlp.up_proj.weight": "model-00002-of-00015.safetensors", "model.layers.9.post_attention_layernorm.weight": "model-00002-of-00015.safetensors", "model.layers.9.self_attn.o_proj.weight": "model-00002-of-00015.safetensors", "model.layers.9.self_attn.v_proj.weight": "model-00002-of-00015.safetensors", "model.layers.9.self_attn.k_proj.weight": "model-00002-of-00015.safetensors", "model.layers.9.self_attn.q_proj.weight": "model-00002-of-00015.safetensors", "model.layers.9.input_layernorm.weight": "model-00002-of-00015.safetensors", "model.layers.8.mlp.down_proj.weight": "model-00002-of-00015.safetensors", "model.layers.8.mlp.gate_proj.weight": "model-00002-of-00015.safetensors", "model.layers.8.mlp.up_proj.weight": "model-00002-of-00015.safetensors", "model.layers.8.post_attention_layernorm.weight": "model-00002-of-00015.safetensors", "model.layers.8.self_attn.o_proj.weight": "model-00002-of-00015.safetensors", "model.layers.8.input_layernorm.weight": "model-00002-of-00015.safetensors", "model.layers.13.mlp.gate_proj.weight": "model-00003-of-00015.safetensors", "model.layers.13.mlp.up_proj.weight": "model-00003-of-00015.safetensors", "model.layers.13.self_attn.o_proj.weight": "model-00003-of-00015.safetensors", "model.layers.13.self_attn.v_proj.weight": "model-00003-of-00015.safetensors", "model.layers.13.self_attn.k_proj.weight": "model-00003-of-00015.safetensors", "model.layers.13.self_attn.q_proj.weight": "model-00003-of-00015.safetensors", "model.layers.12.mlp.down_proj.weight": "model-00003-of-00015.safetensors", "model.layers.12.mlp.gate_proj.weight": "model-00003-of-00015.safetensors", "model.layers.12.mlp.up_proj.weight": "model-00003-of-00015.safetensors", "model.layers.12.post_attention_layernorm.weight": "model-00003-of-00015.safetensors", "model.layers.12.self_attn.o_proj.weight": "model-00003-of-00015.safetensors", "model.layers.12.self_attn.v_proj.weight": "model-00003-of-00015.safetensors", "model.layers.12.self_attn.k_proj.weight": "model-00003-of-00015.safetensors", "model.layers.12.self_attn.q_proj.weight": "model-00003-of-00015.safetensors", "model.layers.12.input_layernorm.weight": "model-00003-of-00015.safetensors", "model.layers.11.mlp.down_proj.weight": "model-00003-of-00015.safetensors", "model.layers.11.mlp.gate_proj.weight": "model-00003-of-00015.safetensors", "model.layers.11.mlp.up_proj.weight": "model-00003-of-00015.safetensors", "model.layers.11.post_attention_layernorm.weight": "model-00003-of-00015.safetensors", "model.layers.11.self_attn.o_proj.weight": "model-00003-of-00015.safetensors", "model.layers.11.self_attn.v_proj.weight": "model-00003-of-00015.safetensors", "model.layers.11.self_attn.k_proj.weight": "model-00003-of-00015.safetensors", "model.layers.11.self_attn.q_proj.weight": "model-00003-of-00015.safetensors", "model.layers.11.input_layernorm.weight": "model-00003-of-00015.safetensors", "model.layers.16.mlp.gate_proj.weight": "model-00003-of-00015.safetensors", "model.layers.16.self_attn.o_proj.weight": "model-00003-of-00015.safetensors", "model.layers.16.self_attn.v_proj.weight": "model-00003-of-00015.safetensors", "model.layers.16.self_attn.k_proj.weight": "model-00003-of-00015.safetensors", "model.layers.16.self_attn.q_proj.weight": "model-00003-of-00015.safetensors", "model.layers.15.mlp.down_proj.weight": "model-00003-of-00015.safetensors", "model.layers.15.mlp.gate_proj.weight": "model-00003-of-00015.safetensors", "model.layers.15.mlp.up_proj.weight": "model-00003-of-00015.safetensors", "model.layers.15.post_attention_layernorm.weight": "model-00003-of-00015.safetensors", "model.layers.15.self_attn.o_proj.weight": "model-00003-of-00015.safetensors", "model.layers.15.self_attn.v_proj.weight": "model-00003-of-00015.safetensors", "model.layers.15.self_attn.k_proj.weight": "model-00003-of-00015.safetensors", "model.layers.15.self_attn.q_proj.weight": "model-00003-of-00015.safetensors", "model.layers.15.input_layernorm.weight": "model-00003-of-00015.safetensors", "model.layers.14.mlp.down_proj.weight": "model-00003-of-00015.safetensors", "model.layers.14.mlp.gate_proj.weight": "model-00003-of-00015.safetensors", "model.layers.14.mlp.up_proj.weight": "model-00003-of-00015.safetensors", "model.layers.14.post_attention_layernorm.weight": "model-00003-of-00015.safetensors", "model.layers.14.self_attn.o_proj.weight": "model-00003-of-00015.safetensors", "model.layers.14.self_attn.v_proj.weight": "model-00003-of-00015.safetensors", "model.layers.14.self_attn.k_proj.weight": "model-00003-of-00015.safetensors", "model.layers.14.self_attn.q_proj.weight": "model-00003-of-00015.safetensors", "model.layers.14.input_layernorm.weight": "model-00003-of-00015.safetensors", "model.layers.13.mlp.down_proj.weight": "model-00003-of-00015.safetensors", "model.layers.13.post_attention_layernorm.weight": "model-00003-of-00015.safetensors", "model.layers.13.input_layernorm.weight": "model-00003-of-00015.safetensors", "model.layers.19.self_attn.o_proj.weight": "model-00003-of-00015.safetensors", "model.layers.19.self_attn.v_proj.weight": "model-00003-of-00015.safetensors", "model.layers.19.self_attn.k_proj.weight": "model-00003-of-00015.safetensors", "model.layers.19.self_attn.q_proj.weight": "model-00003-of-00015.safetensors", "model.layers.18.mlp.down_proj.weight": "model-00004-of-00015.safetensors", "model.layers.18.mlp.gate_proj.weight": "model-00004-of-00015.safetensors", "model.layers.18.mlp.up_proj.weight": "model-00004-of-00015.safetensors", "model.layers.18.post_attention_layernorm.weight": "model-00004-of-00015.safetensors", "model.layers.18.self_attn.o_proj.weight": "model-00004-of-00015.safetensors", "model.layers.18.self_attn.v_proj.weight": "model-00004-of-00015.safetensors", "model.layers.18.self_attn.k_proj.weight": "model-00004-of-00015.safetensors", "model.layers.18.self_attn.q_proj.weight": "model-00004-of-00015.safetensors", "model.layers.18.input_layernorm.weight": "model-00004-of-00015.safetensors", "model.layers.17.mlp.down_proj.weight": "model-00004-of-00015.safetensors", "model.layers.17.mlp.gate_proj.weight": "model-00004-of-00015.safetensors", "model.layers.17.mlp.up_proj.weight": "model-00004-of-00015.safetensors", "model.layers.17.post_attention_layernorm.weight": "model-00004-of-00015.safetensors", "model.layers.17.self_attn.o_proj.weight": "model-00004-of-00015.safetensors", "model.layers.17.self_attn.v_proj.weight": "model-00004-of-00015.safetensors", "model.layers.17.self_attn.k_proj.weight": "model-00004-of-00015.safetensors", "model.layers.17.self_attn.q_proj.weight": "model-00004-of-00015.safetensors", "model.layers.17.input_layernorm.weight": "model-00004-of-00015.safetensors", "model.layers.16.mlp.down_proj.weight": "model-00004-of-00015.safetensors", "model.layers.16.mlp.up_proj.weight": "model-00004-of-00015.safetensors", "model.layers.16.post_attention_layernorm.weight": "model-00004-of-00015.safetensors", "model.layers.16.input_layernorm.weight": "model-00004-of-00015.safetensors", "model.layers.22.self_attn.v_proj.weight": "model-00004-of-00015.safetensors", "model.layers.22.self_attn.k_proj.weight": "model-00004-of-00015.safetensors", "model.layers.22.self_attn.q_proj.weight": "model-00004-of-00015.safetensors", "model.layers.21.mlp.down_proj.weight": "model-00004-of-00015.safetensors", "model.layers.21.mlp.gate_proj.weight": "model-00004-of-00015.safetensors", "model.layers.21.mlp.up_proj.weight": "model-00004-of-00015.safetensors", "model.layers.21.post_attention_layernorm.weight": "model-00004-of-00015.safetensors", "model.layers.21.self_attn.o_proj.weight": "model-00004-of-00015.safetensors", "model.layers.21.self_attn.v_proj.weight": "model-00004-of-00015.safetensors", "model.layers.21.self_attn.k_proj.weight": "model-00004-of-00015.safetensors", "model.layers.21.self_attn.q_proj.weight": "model-00004-of-00015.safetensors", "model.layers.21.input_layernorm.weight": "model-00004-of-00015.safetensors", "model.layers.20.mlp.down_proj.weight": "model-00004-of-00015.safetensors", "model.layers.20.mlp.gate_proj.weight": "model-00004-of-00015.safetensors", "model.layers.20.mlp.up_proj.weight": "model-00004-of-00015.safetensors", "model.layers.20.post_attention_layernorm.weight": "model-00004-of-00015.safetensors", "model.layers.20.self_attn.o_proj.weight": "model-00004-of-00015.safetensors", "model.layers.20.self_attn.v_proj.weight": "model-00004-of-00015.safetensors", "model.layers.20.self_attn.k_proj.weight": "model-00004-of-00015.safetensors", "model.layers.20.self_attn.q_proj.weight": "model-00004-of-00015.safetensors", "model.layers.20.input_layernorm.weight": "model-00004-of-00015.safetensors", "model.layers.19.mlp.down_proj.weight": "model-00004-of-00015.safetensors", "model.layers.19.mlp.gate_proj.weight": "model-00004-of-00015.safetensors", "model.layers.19.mlp.up_proj.weight": "model-00004-of-00015.safetensors", "model.layers.19.post_attention_layernorm.weight": "model-00004-of-00015.safetensors", "model.layers.19.input_layernorm.weight": "model-00004-of-00015.safetensors", "model.layers.24.mlp.down_proj.weight": "model-00004-of-00015.safetensors", "model.layers.24.mlp.gate_proj.weight": "model-00005-of-00015.safetensors", "model.layers.24.mlp.up_proj.weight": "model-00005-of-00015.safetensors", "model.layers.24.post_attention_layernorm.weight": "model-00005-of-00015.safetensors", "model.layers.24.self_attn.o_proj.weight": "model-00005-of-00015.safetensors", "model.layers.24.self_attn.v_proj.weight": "model-00005-of-00015.safetensors", "model.layers.24.self_attn.k_proj.weight": "model-00005-of-00015.safetensors", "model.layers.24.self_attn.q_proj.weight": "model-00005-of-00015.safetensors", "model.layers.24.input_layernorm.weight": "model-00005-of-00015.safetensors", "model.layers.23.mlp.down_proj.weight": "model-00005-of-00015.safetensors", "model.layers.23.mlp.gate_proj.weight": "model-00005-of-00015.safetensors", "model.layers.23.mlp.up_proj.weight": "model-00005-of-00015.safetensors", "model.layers.23.post_attention_layernorm.weight": "model-00005-of-00015.safetensors", "model.layers.23.self_attn.o_proj.weight": "model-00005-of-00015.safetensors", "model.layers.23.self_attn.v_proj.weight": "model-00005-of-00015.safetensors", "model.layers.23.self_attn.k_proj.weight": "model-00005-of-00015.safetensors", "model.layers.23.self_attn.q_proj.weight": "model-00005-of-00015.safetensors", "model.layers.23.input_layernorm.weight": "model-00005-of-00015.safetensors", "model.layers.22.mlp.down_proj.weight": "model-00005-of-00015.safetensors", "model.layers.22.mlp.gate_proj.weight": "model-00005-of-00015.safetensors", "model.layers.22.mlp.up_proj.weight": "model-00005-of-00015.safetensors", "model.layers.22.post_attention_layernorm.weight": "model-00005-of-00015.safetensors", "model.layers.22.self_attn.o_proj.weight": "model-00005-of-00015.safetensors", "model.layers.22.input_layernorm.weight": "model-00005-of-00015.safetensors", "model.layers.27.mlp.gate_proj.weight": "model-00005-of-00015.safetensors", "model.layers.27.mlp.up_proj.weight": "model-00005-of-00015.safetensors", "model.layers.27.self_attn.o_proj.weight": "model-00005-of-00015.safetensors", "model.layers.27.self_attn.v_proj.weight": "model-00005-of-00015.safetensors", "model.layers.27.self_attn.k_proj.weight": "model-00005-of-00015.safetensors", "model.layers.27.self_attn.q_proj.weight": "model-00005-of-00015.safetensors", "model.layers.26.mlp.down_proj.weight": "model-00005-of-00015.safetensors", "model.layers.26.mlp.gate_proj.weight": "model-00005-of-00015.safetensors", "model.layers.26.mlp.up_proj.weight": "model-00005-of-00015.safetensors", "model.layers.26.post_attention_layernorm.weight": "model-00005-of-00015.safetensors", "model.layers.26.self_attn.o_proj.weight": "model-00005-of-00015.safetensors", "model.layers.26.self_attn.v_proj.weight": "model-00005-of-00015.safetensors", "model.layers.26.self_attn.k_proj.weight": "model-00005-of-00015.safetensors", "model.layers.26.self_attn.q_proj.weight": "model-00005-of-00015.safetensors", "model.layers.26.input_layernorm.weight": "model-00005-of-00015.safetensors", "model.layers.25.mlp.down_proj.weight": "model-00005-of-00015.safetensors", "model.layers.25.mlp.gate_proj.weight": "model-00005-of-00015.safetensors", "model.layers.25.mlp.up_proj.weight": "model-00005-of-00015.safetensors", "model.layers.25.post_attention_layernorm.weight": "model-00005-of-00015.safetensors", "model.layers.25.self_attn.o_proj.weight": "model-00005-of-00015.safetensors", "model.layers.25.self_attn.v_proj.weight": "model-00005-of-00015.safetensors", "model.layers.25.self_attn.k_proj.weight": "model-00005-of-00015.safetensors", "model.layers.25.self_attn.q_proj.weight": "model-00005-of-00015.safetensors", "model.layers.25.input_layernorm.weight": "model-00005-of-00015.safetensors", "model.layers.30.mlp.gate_proj.weight": "model-00005-of-00015.safetensors", "model.layers.30.self_attn.o_proj.weight": "model-00005-of-00015.safetensors", "model.layers.30.self_attn.v_proj.weight": "model-00005-of-00015.safetensors", "model.layers.30.self_attn.k_proj.weight": "model-00005-of-00015.safetensors", "model.layers.30.self_attn.q_proj.weight": "model-00005-of-00015.safetensors", "model.layers.29.mlp.down_proj.weight": "model-00006-of-00015.safetensors", "model.layers.29.mlp.gate_proj.weight": "model-00006-of-00015.safetensors", "model.layers.29.mlp.up_proj.weight": "model-00006-of-00015.safetensors", "model.layers.29.post_attention_layernorm.weight": "model-00006-of-00015.safetensors", "model.layers.29.self_attn.o_proj.weight": "model-00006-of-00015.safetensors", "model.layers.29.self_attn.v_proj.weight": "model-00006-of-00015.safetensors", "model.layers.29.self_attn.k_proj.weight": "model-00006-of-00015.safetensors", "model.layers.29.self_attn.q_proj.weight": "model-00006-of-00015.safetensors", "model.layers.29.input_layernorm.weight": "model-00006-of-00015.safetensors", "model.layers.28.mlp.down_proj.weight": "model-00006-of-00015.safetensors", "model.layers.28.mlp.gate_proj.weight": "model-00006-of-00015.safetensors", "model.layers.28.mlp.up_proj.weight": "model-00006-of-00015.safetensors", "model.layers.28.post_attention_layernorm.weight": "model-00006-of-00015.safetensors", "model.layers.28.self_attn.o_proj.weight": "model-00006-of-00015.safetensors", "model.layers.28.self_attn.v_proj.weight": "model-00006-of-00015.safetensors", "model.layers.28.self_attn.k_proj.weight": "model-00006-of-00015.safetensors", "model.layers.28.self_attn.q_proj.weight": "model-00006-of-00015.safetensors", "model.layers.28.input_layernorm.weight": "model-00006-of-00015.safetensors", "model.layers.27.mlp.down_proj.weight": "model-00006-of-00015.safetensors", "model.layers.27.post_attention_layernorm.weight": "model-00006-of-00015.safetensors", "model.layers.27.input_layernorm.weight": "model-00006-of-00015.safetensors", "model.layers.33.self_attn.o_proj.weight": "model-00006-of-00015.safetensors", "model.layers.33.self_attn.v_proj.weight": "model-00006-of-00015.safetensors", "model.layers.33.self_attn.k_proj.weight": "model-00006-of-00015.safetensors", "model.layers.33.self_attn.q_proj.weight": "model-00006-of-00015.safetensors", "model.layers.32.mlp.down_proj.weight": "model-00006-of-00015.safetensors", "model.layers.32.mlp.gate_proj.weight": "model-00006-of-00015.safetensors", "model.layers.32.mlp.up_proj.weight": "model-00006-of-00015.safetensors", "model.layers.32.post_attention_layernorm.weight": "model-00006-of-00015.safetensors", "model.layers.32.self_attn.o_proj.weight": "model-00006-of-00015.safetensors", "model.layers.32.self_attn.v_proj.weight": "model-00006-of-00015.safetensors", "model.layers.32.self_attn.k_proj.weight": "model-00006-of-00015.safetensors", "model.layers.32.self_attn.q_proj.weight": "model-00006-of-00015.safetensors", "model.layers.32.input_layernorm.weight": "model-00006-of-00015.safetensors", "model.layers.31.mlp.down_proj.weight": "model-00006-of-00015.safetensors", "model.layers.31.mlp.gate_proj.weight": "model-00006-of-00015.safetensors", "model.layers.31.mlp.up_proj.weight": "model-00006-of-00015.safetensors", "model.layers.31.post_attention_layernorm.weight": "model-00006-of-00015.safetensors", "model.layers.31.self_attn.o_proj.weight": "model-00006-of-00015.safetensors", "model.layers.31.self_attn.v_proj.weight": "model-00006-of-00015.safetensors", "model.layers.31.self_attn.k_proj.weight": "model-00006-of-00015.safetensors", "model.layers.31.self_attn.q_proj.weight": "model-00006-of-00015.safetensors", "model.layers.31.input_layernorm.weight": "model-00006-of-00015.safetensors", "model.layers.30.mlp.down_proj.weight": "model-00006-of-00015.safetensors", "model.layers.30.mlp.up_proj.weight": "model-00006-of-00015.safetensors", "model.layers.30.post_attention_layernorm.weight": "model-00006-of-00015.safetensors", "model.layers.30.input_layernorm.weight": "model-00006-of-00015.safetensors", "model.layers.36.self_attn.v_proj.weight": "model-00006-of-00015.safetensors", "model.layers.36.self_attn.k_proj.weight": "model-00006-of-00015.safetensors", "model.layers.36.self_attn.q_proj.weight": "model-00006-of-00015.safetensors", "model.layers.35.mlp.down_proj.weight": "model-00006-of-00015.safetensors", "model.layers.35.mlp.gate_proj.weight": "model-00006-of-00015.safetensors", "model.layers.35.mlp.up_proj.weight": "model-00007-of-00015.safetensors", "model.layers.35.post_attention_layernorm.weight": "model-00007-of-00015.safetensors", "model.layers.35.self_attn.o_proj.weight": "model-00007-of-00015.safetensors", "model.layers.35.self_attn.v_proj.weight": "model-00007-of-00015.safetensors", "model.layers.35.self_attn.k_proj.weight": "model-00007-of-00015.safetensors", "model.layers.35.self_attn.q_proj.weight": "model-00007-of-00015.safetensors", "model.layers.35.input_layernorm.weight": "model-00007-of-00015.safetensors", "model.layers.34.mlp.down_proj.weight": "model-00007-of-00015.safetensors", "model.layers.34.mlp.gate_proj.weight": "model-00007-of-00015.safetensors", "model.layers.34.mlp.up_proj.weight": "model-00007-of-00015.safetensors", "model.layers.34.post_attention_layernorm.weight": "model-00007-of-00015.safetensors", "model.layers.34.self_attn.o_proj.weight": "model-00007-of-00015.safetensors", "model.layers.34.self_attn.v_proj.weight": "model-00007-of-00015.safetensors", "model.layers.34.self_attn.k_proj.weight": "model-00007-of-00015.safetensors", "model.layers.34.self_attn.q_proj.weight": "model-00007-of-00015.safetensors", "model.layers.34.input_layernorm.weight": "model-00007-of-00015.safetensors", "model.layers.33.mlp.down_proj.weight": "model-00007-of-00015.safetensors", "model.layers.33.mlp.gate_proj.weight": "model-00007-of-00015.safetensors", "model.layers.33.mlp.up_proj.weight": "model-00007-of-00015.safetensors", "model.layers.33.post_attention_layernorm.weight": "model-00007-of-00015.safetensors", "model.layers.33.input_layernorm.weight": "model-00007-of-00015.safetensors", "model.layers.38.mlp.down_proj.weight": "model-00007-of-00015.safetensors", "model.layers.38.mlp.gate_proj.weight": "model-00007-of-00015.safetensors", "model.layers.38.mlp.up_proj.weight": "model-00007-of-00015.safetensors", "model.layers.38.post_attention_layernorm.weight": "model-00007-of-00015.safetensors", "model.layers.38.self_attn.o_proj.weight": "model-00007-of-00015.safetensors", "model.layers.38.self_attn.v_proj.weight": "model-00007-of-00015.safetensors", "model.layers.38.self_attn.k_proj.weight": "model-00007-of-00015.safetensors", "model.layers.38.self_attn.q_proj.weight": "model-00007-of-00015.safetensors", "model.layers.38.input_layernorm.weight": "model-00007-of-00015.safetensors", "model.layers.37.mlp.down_proj.weight": "model-00007-of-00015.safetensors", "model.layers.37.mlp.gate_proj.weight": "model-00007-of-00015.safetensors", "model.layers.37.mlp.up_proj.weight": "model-00007-of-00015.safetensors", "model.layers.37.post_attention_layernorm.weight": "model-00007-of-00015.safetensors", "model.layers.37.self_attn.o_proj.weight": "model-00007-of-00015.safetensors", "model.layers.37.self_attn.v_proj.weight": "model-00007-of-00015.safetensors", "model.layers.37.self_attn.k_proj.weight": "model-00007-of-00015.safetensors", "model.layers.37.self_attn.q_proj.weight": "model-00007-of-00015.safetensors", "model.layers.37.input_layernorm.weight": "model-00007-of-00015.safetensors", "model.layers.36.mlp.down_proj.weight": "model-00007-of-00015.safetensors", "model.layers.36.mlp.gate_proj.weight": "model-00007-of-00015.safetensors", "model.layers.36.mlp.up_proj.weight": "model-00007-of-00015.safetensors", "model.layers.36.post_attention_layernorm.weight": "model-00007-of-00015.safetensors", "model.layers.36.self_attn.o_proj.weight": "model-00007-of-00015.safetensors", "model.layers.36.input_layernorm.weight": "model-00007-of-00015.safetensors", "model.layers.41.mlp.gate_proj.weight": "model-00007-of-00015.safetensors", "model.layers.41.mlp.up_proj.weight": "model-00007-of-00015.safetensors", "model.layers.41.self_attn.o_proj.weight": "model-00007-of-00015.safetensors", "model.layers.41.self_attn.v_proj.weight": "model-00007-of-00015.safetensors", "model.layers.41.self_attn.k_proj.weight": "model-00007-of-00015.safetensors", "model.layers.41.self_attn.q_proj.weight": "model-00008-of-00015.safetensors", "model.layers.40.mlp.down_proj.weight": "model-00008-of-00015.safetensors", "model.layers.40.mlp.gate_proj.weight": "model-00008-of-00015.safetensors", "model.layers.40.mlp.up_proj.weight": "model-00008-of-00015.safetensors", "model.layers.40.post_attention_layernorm.weight": "model-00008-of-00015.safetensors", "model.layers.40.self_attn.o_proj.weight": "model-00008-of-00015.safetensors", "model.layers.40.self_attn.v_proj.weight": "model-00008-of-00015.safetensors", "model.layers.40.self_attn.k_proj.weight": "model-00008-of-00015.safetensors", "model.layers.40.self_attn.q_proj.weight": "model-00008-of-00015.safetensors", "model.layers.40.input_layernorm.weight": "model-00008-of-00015.safetensors", "model.layers.39.mlp.down_proj.weight": "model-00008-of-00015.safetensors", "model.layers.39.mlp.gate_proj.weight": "model-00008-of-00015.safetensors", "model.layers.39.mlp.up_proj.weight": "model-00008-of-00015.safetensors", "model.layers.39.post_attention_layernorm.weight": "model-00008-of-00015.safetensors", "model.layers.39.self_attn.o_proj.weight": "model-00008-of-00015.safetensors", "model.layers.39.self_attn.v_proj.weight": "model-00008-of-00015.safetensors", "model.layers.39.self_attn.k_proj.weight": "model-00008-of-00015.safetensors", "model.layers.39.self_attn.q_proj.weight": "model-00008-of-00015.safetensors", "model.layers.39.input_layernorm.weight": "model-00008-of-00015.safetensors", "model.layers.44.mlp.gate_proj.weight": "model-00008-of-00015.safetensors", "model.layers.44.self_attn.o_proj.weight": "model-00008-of-00015.safetensors", "model.layers.44.self_attn.v_proj.weight": "model-00008-of-00015.safetensors", "model.layers.44.self_attn.k_proj.weight": "model-00008-of-00015.safetensors", "model.layers.44.self_attn.q_proj.weight": "model-00008-of-00015.safetensors", "model.layers.43.mlp.down_proj.weight": "model-00008-of-00015.safetensors", "model.layers.43.mlp.gate_proj.weight": "model-00008-of-00015.safetensors", "model.layers.43.mlp.up_proj.weight": "model-00008-of-00015.safetensors", "model.layers.43.post_attention_layernorm.weight": "model-00008-of-00015.safetensors", "model.layers.43.self_attn.o_proj.weight": "model-00008-of-00015.safetensors", "model.layers.43.self_attn.v_proj.weight": "model-00008-of-00015.safetensors", "model.layers.43.self_attn.k_proj.weight": "model-00008-of-00015.safetensors", "model.layers.43.self_attn.q_proj.weight": "model-00008-of-00015.safetensors", "model.layers.43.input_layernorm.weight": "model-00008-of-00015.safetensors", "model.layers.42.mlp.down_proj.weight": "model-00008-of-00015.safetensors", "model.layers.42.mlp.gate_proj.weight": "model-00008-of-00015.safetensors", "model.layers.42.mlp.up_proj.weight": "model-00008-of-00015.safetensors", "model.layers.42.post_attention_layernorm.weight": "model-00008-of-00015.safetensors", "model.layers.42.self_attn.o_proj.weight": "model-00008-of-00015.safetensors", "model.layers.42.self_attn.v_proj.weight": "model-00008-of-00015.safetensors", "model.layers.42.self_attn.k_proj.weight": "model-00008-of-00015.safetensors", "model.layers.42.self_attn.q_proj.weight": "model-00008-of-00015.safetensors", "model.layers.42.input_layernorm.weight": "model-00008-of-00015.safetensors", "model.layers.41.mlp.down_proj.weight": "model-00008-of-00015.safetensors", "model.layers.41.post_attention_layernorm.weight": "model-00008-of-00015.safetensors", "model.layers.41.input_layernorm.weight": "model-00008-of-00015.safetensors", "model.layers.47.self_attn.o_proj.weight": "model-00008-of-00015.safetensors", "model.layers.47.self_attn.v_proj.weight": "model-00008-of-00015.safetensors", "model.layers.47.self_attn.k_proj.weight": "model-00008-of-00015.safetensors", "model.layers.47.self_attn.q_proj.weight": "model-00008-of-00015.safetensors", "model.layers.46.mlp.down_proj.weight": "model-00008-of-00015.safetensors", "model.layers.46.mlp.gate_proj.weight": "model-00008-of-00015.safetensors", "model.layers.46.mlp.up_proj.weight": "model-00008-of-00015.safetensors", "model.layers.46.post_attention_layernorm.weight": "model-00008-of-00015.safetensors", "model.layers.46.self_attn.o_proj.weight": "model-00009-of-00015.safetensors", "model.layers.46.self_attn.v_proj.weight": "model-00009-of-00015.safetensors", "model.layers.46.self_attn.k_proj.weight": "model-00009-of-00015.safetensors", "model.layers.46.self_attn.q_proj.weight": "model-00009-of-00015.safetensors", "model.layers.46.input_layernorm.weight": "model-00009-of-00015.safetensors", "model.layers.45.mlp.down_proj.weight": "model-00009-of-00015.safetensors", "model.layers.45.mlp.gate_proj.weight": "model-00009-of-00015.safetensors", "model.layers.45.mlp.up_proj.weight": "model-00009-of-00015.safetensors", "model.layers.45.post_attention_layernorm.weight": "model-00009-of-00015.safetensors", "model.layers.45.self_attn.o_proj.weight": "model-00009-of-00015.safetensors", "model.layers.45.self_attn.v_proj.weight": "model-00009-of-00015.safetensors", "model.layers.45.self_attn.k_proj.weight": "model-00009-of-00015.safetensors", "model.layers.45.self_attn.q_proj.weight": "model-00009-of-00015.safetensors", "model.layers.45.input_layernorm.weight": "model-00009-of-00015.safetensors", "model.layers.44.mlp.down_proj.weight": "model-00009-of-00015.safetensors", "model.layers.44.mlp.up_proj.weight": "model-00009-of-00015.safetensors", "model.layers.44.post_attention_layernorm.weight": "model-00009-of-00015.safetensors", "model.layers.44.input_layernorm.weight": "model-00009-of-00015.safetensors", "model.layers.50.self_attn.v_proj.weight": "model-00009-of-00015.safetensors", "model.layers.50.self_attn.k_proj.weight": "model-00009-of-00015.safetensors", "model.layers.50.self_attn.q_proj.weight": "model-00009-of-00015.safetensors", "model.layers.49.mlp.down_proj.weight": "model-00009-of-00015.safetensors", "model.layers.49.mlp.gate_proj.weight": "model-00009-of-00015.safetensors", "model.layers.49.mlp.up_proj.weight": "model-00009-of-00015.safetensors", "model.layers.49.post_attention_layernorm.weight": "model-00009-of-00015.safetensors", "model.layers.49.self_attn.o_proj.weight": "model-00009-of-00015.safetensors", "model.layers.49.self_attn.v_proj.weight": "model-00009-of-00015.safetensors", "model.layers.49.self_attn.k_proj.weight": "model-00009-of-00015.safetensors", "model.layers.49.self_attn.q_proj.weight": "model-00009-of-00015.safetensors", "model.layers.49.input_layernorm.weight": "model-00009-of-00015.safetensors", "model.layers.48.mlp.down_proj.weight": "model-00009-of-00015.safetensors", "model.layers.48.mlp.gate_proj.weight": "model-00009-of-00015.safetensors", "model.layers.48.mlp.up_proj.weight": "model-00009-of-00015.safetensors", "model.layers.48.post_attention_layernorm.weight": "model-00009-of-00015.safetensors", "model.layers.48.self_attn.o_proj.weight": "model-00009-of-00015.safetensors", "model.layers.48.self_attn.v_proj.weight": "model-00009-of-00015.safetensors", "model.layers.48.self_attn.k_proj.weight": "model-00009-of-00015.safetensors", "model.layers.48.self_attn.q_proj.weight": "model-00009-of-00015.safetensors", "model.layers.48.input_layernorm.weight": "model-00009-of-00015.safetensors", "model.layers.47.mlp.down_proj.weight": "model-00009-of-00015.safetensors", "model.layers.47.mlp.gate_proj.weight": "model-00009-of-00015.safetensors", "model.layers.47.mlp.up_proj.weight": "model-00009-of-00015.safetensors", "model.layers.47.post_attention_layernorm.weight": "model-00009-of-00015.safetensors", "model.layers.47.input_layernorm.weight": "model-00009-of-00015.safetensors", "model.layers.52.mlp.down_proj.weight": "model-00009-of-00015.safetensors", "model.layers.52.mlp.gate_proj.weight": "model-00009-of-00015.safetensors", "model.layers.52.mlp.up_proj.weight": "model-00009-of-00015.safetensors", "model.layers.52.post_attention_layernorm.weight": "model-00009-of-00015.safetensors", "model.layers.52.self_attn.o_proj.weight": "model-00009-of-00015.safetensors", "model.layers.52.self_attn.v_proj.weight": "model-00009-of-00015.safetensors", "model.layers.52.self_attn.k_proj.weight": "model-00009-of-00015.safetensors", "model.layers.52.self_attn.q_proj.weight": "model-00009-of-00015.safetensors", "model.layers.52.input_layernorm.weight": "model-00009-of-00015.safetensors", "model.layers.51.mlp.down_proj.weight": "model-00010-of-00015.safetensors", "model.layers.51.mlp.gate_proj.weight": "model-00010-of-00015.safetensors", "model.layers.51.mlp.up_proj.weight": "model-00010-of-00015.safetensors", "model.layers.51.post_attention_layernorm.weight": "model-00010-of-00015.safetensors", "model.layers.51.self_attn.o_proj.weight": "model-00010-of-00015.safetensors", "model.layers.51.self_attn.v_proj.weight": "model-00010-of-00015.safetensors", "model.layers.51.self_attn.k_proj.weight": "model-00010-of-00015.safetensors", "model.layers.51.self_attn.q_proj.weight": "model-00010-of-00015.safetensors", "model.layers.51.input_layernorm.weight": "model-00010-of-00015.safetensors", "model.layers.50.mlp.down_proj.weight": "model-00010-of-00015.safetensors", "model.layers.50.mlp.gate_proj.weight": "model-00010-of-00015.safetensors", "model.layers.50.mlp.up_proj.weight": "model-00010-of-00015.safetensors", "model.layers.50.post_attention_layernorm.weight": "model-00010-of-00015.safetensors", "model.layers.50.self_attn.o_proj.weight": "model-00010-of-00015.safetensors", "model.layers.50.input_layernorm.weight": "model-00010-of-00015.safetensors", "model.layers.55.mlp.gate_proj.weight": "model-00010-of-00015.safetensors", "model.layers.55.mlp.up_proj.weight": "model-00010-of-00015.safetensors", "model.layers.55.self_attn.o_proj.weight": "model-00010-of-00015.safetensors", "model.layers.55.self_attn.v_proj.weight": "model-00010-of-00015.safetensors", "model.layers.55.self_attn.k_proj.weight": "model-00010-of-00015.safetensors", "model.layers.55.self_attn.q_proj.weight": "model-00010-of-00015.safetensors", "model.layers.54.mlp.down_proj.weight": "model-00010-of-00015.safetensors", "model.layers.54.mlp.gate_proj.weight": "model-00010-of-00015.safetensors", "model.layers.54.mlp.up_proj.weight": "model-00010-of-00015.safetensors", "model.layers.54.post_attention_layernorm.weight": "model-00010-of-00015.safetensors", "model.layers.54.self_attn.o_proj.weight": "model-00010-of-00015.safetensors", "model.layers.54.self_attn.v_proj.weight": "model-00010-of-00015.safetensors", "model.layers.54.self_attn.k_proj.weight": "model-00010-of-00015.safetensors", "model.layers.54.self_attn.q_proj.weight": "model-00010-of-00015.safetensors", "model.layers.54.input_layernorm.weight": "model-00010-of-00015.safetensors", "model.layers.53.mlp.down_proj.weight": "model-00010-of-00015.safetensors", "model.layers.53.mlp.gate_proj.weight": "model-00010-of-00015.safetensors", "model.layers.53.mlp.up_proj.weight": "model-00010-of-00015.safetensors", "model.layers.53.post_attention_layernorm.weight": "model-00010-of-00015.safetensors", "model.layers.53.self_attn.o_proj.weight": "model-00010-of-00015.safetensors", "model.layers.53.self_attn.v_proj.weight": "model-00010-of-00015.safetensors", "model.layers.53.self_attn.k_proj.weight": "model-00010-of-00015.safetensors", "model.layers.53.self_attn.q_proj.weight": "model-00010-of-00015.safetensors", "model.layers.53.input_layernorm.weight": "model-00010-of-00015.safetensors", "model.layers.58.mlp.gate_proj.weight": "model-00010-of-00015.safetensors", "model.layers.58.self_attn.o_proj.weight": "model-00010-of-00015.safetensors", "model.layers.58.self_attn.v_proj.weight": "model-00010-of-00015.safetensors", "model.layers.58.self_attn.k_proj.weight": "model-00010-of-00015.safetensors", "model.layers.58.self_attn.q_proj.weight": "model-00010-of-00015.safetensors", "model.layers.57.mlp.down_proj.weight": "model-00010-of-00015.safetensors", "model.layers.57.mlp.gate_proj.weight": "model-00010-of-00015.safetensors", "model.layers.57.mlp.up_proj.weight": "model-00011-of-00015.safetensors", "model.layers.57.post_attention_layernorm.weight": "model-00011-of-00015.safetensors", "model.layers.57.self_attn.o_proj.weight": "model-00011-of-00015.safetensors", "model.layers.57.self_attn.v_proj.weight": "model-00011-of-00015.safetensors", "model.layers.57.self_attn.k_proj.weight": "model-00011-of-00015.safetensors", "model.layers.57.self_attn.q_proj.weight": "model-00011-of-00015.safetensors", "model.layers.57.input_layernorm.weight": "model-00011-of-00015.safetensors", "model.layers.56.mlp.down_proj.weight": "model-00011-of-00015.safetensors", "model.layers.56.mlp.gate_proj.weight": "model-00011-of-00015.safetensors", "model.layers.56.mlp.up_proj.weight": "model-00011-of-00015.safetensors", "model.layers.56.post_attention_layernorm.weight": "model-00011-of-00015.safetensors", "model.layers.56.self_attn.o_proj.weight": "model-00011-of-00015.safetensors", "model.layers.56.self_attn.v_proj.weight": "model-00011-of-00015.safetensors", "model.layers.56.self_attn.k_proj.weight": "model-00011-of-00015.safetensors", "model.layers.56.self_attn.q_proj.weight": "model-00011-of-00015.safetensors", "model.layers.56.input_layernorm.weight": "model-00011-of-00015.safetensors", "model.layers.55.mlp.down_proj.weight": "model-00011-of-00015.safetensors", "model.layers.55.post_attention_layernorm.weight": "model-00011-of-00015.safetensors", "model.layers.55.input_layernorm.weight": "model-00011-of-00015.safetensors", "model.layers.61.self_attn.o_proj.weight": "model-00011-of-00015.safetensors", "model.layers.61.self_attn.v_proj.weight": "model-00011-of-00015.safetensors", "model.layers.61.self_attn.k_proj.weight": "model-00011-of-00015.safetensors", "model.layers.61.self_attn.q_proj.weight": "model-00011-of-00015.safetensors", "model.layers.60.mlp.down_proj.weight": "model-00011-of-00015.safetensors", "model.layers.60.mlp.gate_proj.weight": "model-00011-of-00015.safetensors", "model.layers.60.mlp.up_proj.weight": "model-00011-of-00015.safetensors", "model.layers.60.post_attention_layernorm.weight": "model-00011-of-00015.safetensors", "model.layers.60.self_attn.o_proj.weight": "model-00011-of-00015.safetensors", "model.layers.60.self_attn.v_proj.weight": "model-00011-of-00015.safetensors", "model.layers.60.self_attn.k_proj.weight": "model-00011-of-00015.safetensors", "model.layers.60.self_attn.q_proj.weight": "model-00011-of-00015.safetensors", "model.layers.60.input_layernorm.weight": "model-00011-of-00015.safetensors", "model.layers.59.mlp.down_proj.weight": "model-00011-of-00015.safetensors", "model.layers.59.mlp.gate_proj.weight": "model-00011-of-00015.safetensors", "model.layers.59.mlp.up_proj.weight": "model-00011-of-00015.safetensors", "model.layers.59.post_attention_layernorm.weight": "model-00011-of-00015.safetensors", "model.layers.59.self_attn.o_proj.weight": "model-00011-of-00015.safetensors", "model.layers.59.self_attn.v_proj.weight": "model-00011-of-00015.safetensors", "model.layers.59.self_attn.k_proj.weight": "model-00011-of-00015.safetensors", "model.layers.59.self_attn.q_proj.weight": "model-00011-of-00015.safetensors", "model.layers.59.input_layernorm.weight": "model-00011-of-00015.safetensors", "model.layers.58.mlp.down_proj.weight": "model-00011-of-00015.safetensors", "model.layers.58.mlp.up_proj.weight": "model-00011-of-00015.safetensors", "model.layers.58.post_attention_layernorm.weight": "model-00011-of-00015.safetensors", "model.layers.58.input_layernorm.weight": "model-00011-of-00015.safetensors", "model.layers.64.self_attn.v_proj.weight": "model-00011-of-00015.safetensors", "model.layers.64.self_attn.k_proj.weight": "model-00011-of-00015.safetensors", "model.layers.64.self_attn.q_proj.weight": "model-00011-of-00015.safetensors", "model.layers.63.mlp.down_proj.weight": "model-00011-of-00015.safetensors", "model.layers.63.mlp.gate_proj.weight": "model-00011-of-00015.safetensors", "model.layers.63.mlp.up_proj.weight": "model-00011-of-00015.safetensors", "model.layers.63.post_attention_layernorm.weight": "model-00011-of-00015.safetensors", "model.layers.63.self_attn.o_proj.weight": "model-00011-of-00015.safetensors", "model.layers.63.self_attn.v_proj.weight": "model-00011-of-00015.safetensors", "model.layers.63.self_attn.k_proj.weight": "model-00011-of-00015.safetensors", "model.layers.63.self_attn.q_proj.weight": "model-00011-of-00015.safetensors", "model.layers.63.input_layernorm.weight": "model-00011-of-00015.safetensors", "model.layers.62.mlp.down_proj.weight": "model-00011-of-00015.safetensors", "model.layers.62.mlp.gate_proj.weight": "model-00012-of-00015.safetensors", "model.layers.62.mlp.up_proj.weight": "model-00012-of-00015.safetensors", "model.layers.62.post_attention_layernorm.weight": "model-00012-of-00015.safetensors", "model.layers.62.self_attn.o_proj.weight": "model-00012-of-00015.safetensors", "model.layers.62.self_attn.v_proj.weight": "model-00012-of-00015.safetensors", "model.layers.62.self_attn.k_proj.weight": "model-00012-of-00015.safetensors", "model.layers.62.self_attn.q_proj.weight": "model-00012-of-00015.safetensors", "model.layers.62.input_layernorm.weight": "model-00012-of-00015.safetensors", "model.layers.61.mlp.down_proj.weight": "model-00012-of-00015.safetensors", "model.layers.61.mlp.gate_proj.weight": "model-00012-of-00015.safetensors", "model.layers.61.mlp.up_proj.weight": "model-00012-of-00015.safetensors", "model.layers.61.post_attention_layernorm.weight": "model-00012-of-00015.safetensors", "model.layers.61.input_layernorm.weight": "model-00012-of-00015.safetensors", "model.layers.66.mlp.down_proj.weight": "model-00012-of-00015.safetensors", "model.layers.66.mlp.gate_proj.weight": "model-00012-of-00015.safetensors", "model.layers.66.mlp.up_proj.weight": "model-00012-of-00015.safetensors", "model.layers.66.post_attention_layernorm.weight": "model-00012-of-00015.safetensors", "model.layers.66.self_attn.o_proj.weight": "model-00012-of-00015.safetensors", "model.layers.66.self_attn.v_proj.weight": "model-00012-of-00015.safetensors", "model.layers.66.self_attn.k_proj.weight": "model-00012-of-00015.safetensors", "model.layers.66.self_attn.q_proj.weight": "model-00012-of-00015.safetensors", "model.layers.66.input_layernorm.weight": "model-00012-of-00015.safetensors", "model.layers.65.mlp.down_proj.weight": "model-00012-of-00015.safetensors", "model.layers.65.mlp.gate_proj.weight": "model-00012-of-00015.safetensors", "model.layers.65.mlp.up_proj.weight": "model-00012-of-00015.safetensors", "model.layers.65.post_attention_layernorm.weight": "model-00012-of-00015.safetensors", "model.layers.65.self_attn.o_proj.weight": "model-00012-of-00015.safetensors", "model.layers.65.self_attn.v_proj.weight": "model-00012-of-00015.safetensors", "model.layers.65.self_attn.k_proj.weight": "model-00012-of-00015.safetensors", "model.layers.65.self_attn.q_proj.weight": "model-00012-of-00015.safetensors", "model.layers.65.input_layernorm.weight": "model-00012-of-00015.safetensors", "model.layers.64.mlp.down_proj.weight": "model-00012-of-00015.safetensors", "model.layers.64.mlp.gate_proj.weight": "model-00012-of-00015.safetensors", "model.layers.64.mlp.up_proj.weight": "model-00012-of-00015.safetensors", "model.layers.64.post_attention_layernorm.weight": "model-00012-of-00015.safetensors", "model.layers.64.self_attn.o_proj.weight": "model-00012-of-00015.safetensors", "model.layers.64.input_layernorm.weight": "model-00012-of-00015.safetensors", "model.layers.69.mlp.gate_proj.weight": "model-00012-of-00015.safetensors", "model.layers.69.mlp.up_proj.weight": "model-00012-of-00015.safetensors", "model.layers.69.self_attn.o_proj.weight": "model-00012-of-00015.safetensors", "model.layers.69.self_attn.v_proj.weight": "model-00012-of-00015.safetensors", "model.layers.69.self_attn.k_proj.weight": "model-00012-of-00015.safetensors", "model.layers.69.self_attn.q_proj.weight": "model-00012-of-00015.safetensors", "model.layers.68.mlp.down_proj.weight": "model-00012-of-00015.safetensors", "model.layers.68.mlp.gate_proj.weight": "model-00012-of-00015.safetensors", "model.layers.68.mlp.up_proj.weight": "model-00013-of-00015.safetensors", "model.layers.68.post_attention_layernorm.weight": "model-00013-of-00015.safetensors", "model.layers.68.self_attn.o_proj.weight": "model-00013-of-00015.safetensors", "model.layers.68.self_attn.v_proj.weight": "model-00013-of-00015.safetensors", "model.layers.68.self_attn.k_proj.weight": "model-00013-of-00015.safetensors", "model.layers.68.self_attn.q_proj.weight": "model-00013-of-00015.safetensors", "model.layers.68.input_layernorm.weight": "model-00013-of-00015.safetensors", "model.layers.67.mlp.down_proj.weight": "model-00013-of-00015.safetensors", "model.layers.67.mlp.gate_proj.weight": "model-00013-of-00015.safetensors", "model.layers.67.mlp.up_proj.weight": "model-00013-of-00015.safetensors", "model.layers.67.post_attention_layernorm.weight": "model-00013-of-00015.safetensors", "model.layers.67.self_attn.o_proj.weight": "model-00013-of-00015.safetensors", "model.layers.67.self_attn.v_proj.weight": "model-00013-of-00015.safetensors", "model.layers.67.self_attn.k_proj.weight": "model-00013-of-00015.safetensors", "model.layers.67.self_attn.q_proj.weight": "model-00013-of-00015.safetensors", "model.layers.67.input_layernorm.weight": "model-00013-of-00015.safetensors", "model.layers.72.mlp.gate_proj.weight": "model-00013-of-00015.safetensors", "model.layers.72.self_attn.o_proj.weight": "model-00013-of-00015.safetensors", "model.layers.72.self_attn.v_proj.weight": "model-00013-of-00015.safetensors", "model.layers.72.self_attn.k_proj.weight": "model-00013-of-00015.safetensors", "model.layers.72.self_attn.q_proj.weight": "model-00013-of-00015.safetensors", "model.layers.71.mlp.down_proj.weight": "model-00013-of-00015.safetensors", "model.layers.71.mlp.gate_proj.weight": "model-00013-of-00015.safetensors", "model.layers.71.mlp.up_proj.weight": "model-00013-of-00015.safetensors", "model.layers.71.post_attention_layernorm.weight": "model-00013-of-00015.safetensors", "model.layers.71.self_attn.o_proj.weight": "model-00013-of-00015.safetensors", "model.layers.71.self_attn.v_proj.weight": "model-00013-of-00015.safetensors", "model.layers.71.self_attn.k_proj.weight": "model-00013-of-00015.safetensors", "model.layers.71.self_attn.q_proj.weight": "model-00013-of-00015.safetensors", "model.layers.71.input_layernorm.weight": "model-00013-of-00015.safetensors", "model.layers.70.mlp.down_proj.weight": "model-00013-of-00015.safetensors", "model.layers.70.mlp.gate_proj.weight": "model-00013-of-00015.safetensors", "model.layers.70.mlp.up_proj.weight": "model-00013-of-00015.safetensors", "model.layers.70.post_attention_layernorm.weight": "model-00013-of-00015.safetensors", "model.layers.70.self_attn.o_proj.weight": "model-00013-of-00015.safetensors", "model.layers.70.self_attn.v_proj.weight": "model-00013-of-00015.safetensors", "model.layers.70.self_attn.k_proj.weight": "model-00013-of-00015.safetensors", "model.layers.70.self_attn.q_proj.weight": "model-00013-of-00015.safetensors", "model.layers.70.input_layernorm.weight": "model-00013-of-00015.safetensors", "model.layers.69.mlp.down_proj.weight": "model-00013-of-00015.safetensors", "model.layers.69.post_attention_layernorm.weight": "model-00013-of-00015.safetensors", "model.layers.69.input_layernorm.weight": "model-00013-of-00015.safetensors", "model.layers.75.self_attn.o_proj.weight": "model-00013-of-00015.safetensors", "model.layers.75.self_attn.v_proj.weight": "model-00013-of-00015.safetensors", "model.layers.75.self_attn.k_proj.weight": "model-00013-of-00015.safetensors", "model.layers.75.self_attn.q_proj.weight": "model-00013-of-00015.safetensors", "model.layers.74.mlp.down_proj.weight": "model-00013-of-00015.safetensors", "model.layers.74.mlp.gate_proj.weight": "model-00013-of-00015.safetensors", "model.layers.74.mlp.up_proj.weight": "model-00013-of-00015.safetensors", "model.layers.74.post_attention_layernorm.weight": "model-00013-of-00015.safetensors", "model.layers.74.self_attn.o_proj.weight": "model-00013-of-00015.safetensors", "model.layers.74.self_attn.v_proj.weight": "model-00013-of-00015.safetensors", "model.layers.74.self_attn.k_proj.weight": "model-00013-of-00015.safetensors", "model.layers.74.self_attn.q_proj.weight": "model-00013-of-00015.safetensors", "model.layers.74.input_layernorm.weight": "model-00013-of-00015.safetensors", "model.layers.73.mlp.down_proj.weight": "model-00013-of-00015.safetensors", "model.layers.73.mlp.gate_proj.weight": "model-00014-of-00015.safetensors", "model.layers.73.mlp.up_proj.weight": "model-00014-of-00015.safetensors", "model.layers.73.post_attention_layernorm.weight": "model-00014-of-00015.safetensors", "model.layers.73.self_attn.o_proj.weight": "model-00014-of-00015.safetensors", "model.layers.73.self_attn.v_proj.weight": "model-00014-of-00015.safetensors", "model.layers.73.self_attn.k_proj.weight": "model-00014-of-00015.safetensors", "model.layers.73.self_attn.q_proj.weight": "model-00014-of-00015.safetensors", "model.layers.73.input_layernorm.weight": "model-00014-of-00015.safetensors", "model.layers.72.mlp.down_proj.weight": "model-00014-of-00015.safetensors", "model.layers.72.mlp.up_proj.weight": "model-00014-of-00015.safetensors", "model.layers.72.post_attention_layernorm.weight": "model-00014-of-00015.safetensors", "model.layers.72.input_layernorm.weight": "model-00014-of-00015.safetensors", "model.layers.78.self_attn.v_proj.weight": "model-00014-of-00015.safetensors", "model.layers.78.self_attn.k_proj.weight": "model-00014-of-00015.safetensors", "model.layers.78.self_attn.q_proj.weight": "model-00014-of-00015.safetensors", "model.layers.77.mlp.down_proj.weight": "model-00014-of-00015.safetensors", "model.layers.77.mlp.gate_proj.weight": "model-00014-of-00015.safetensors", "model.layers.77.mlp.up_proj.weight": "model-00014-of-00015.safetensors", "model.layers.77.post_attention_layernorm.weight": "model-00014-of-00015.safetensors", "model.layers.77.self_attn.o_proj.weight": "model-00014-of-00015.safetensors", "model.layers.77.self_attn.v_proj.weight": "model-00014-of-00015.safetensors", "model.layers.77.self_attn.k_proj.weight": "model-00014-of-00015.safetensors", "model.layers.77.self_attn.q_proj.weight": "model-00014-of-00015.safetensors", "model.layers.77.input_layernorm.weight": "model-00014-of-00015.safetensors", "model.layers.76.mlp.down_proj.weight": "model-00014-of-00015.safetensors", "model.layers.76.mlp.gate_proj.weight": "model-00014-of-00015.safetensors", "model.layers.76.mlp.up_proj.weight": "model-00014-of-00015.safetensors", "model.layers.76.post_attention_layernorm.weight": "model-00014-of-00015.safetensors", "model.layers.76.self_attn.o_proj.weight": "model-00014-of-00015.safetensors", "model.layers.76.self_attn.v_proj.weight": "model-00014-of-00015.safetensors", "model.layers.76.self_attn.k_proj.weight": "model-00014-of-00015.safetensors", "model.layers.76.self_attn.q_proj.weight": "model-00014-of-00015.safetensors", "model.layers.76.input_layernorm.weight": "model-00014-of-00015.safetensors", "model.layers.75.mlp.down_proj.weight": "model-00014-of-00015.safetensors", "model.layers.75.mlp.gate_proj.weight": "model-00014-of-00015.safetensors", "model.layers.75.mlp.up_proj.weight": "model-00014-of-00015.safetensors", "model.layers.75.post_attention_layernorm.weight": "model-00014-of-00015.safetensors", "model.layers.75.input_layernorm.weight": "model-00014-of-00015.safetensors", "lm_head.weight": "model-00014-of-00015.safetensors", "model.norm.weight": "model-00014-of-00015.safetensors", "model.layers.79.mlp.down_proj.weight": "model-00014-of-00015.safetensors", "model.layers.79.mlp.gate_proj.weight": "model-00014-of-00015.safetensors", "model.layers.79.mlp.up_proj.weight": "model-00014-of-00015.safetensors", "model.layers.79.post_attention_layernorm.weight": "model-00014-of-00015.safetensors", "model.layers.79.self_attn.o_proj.weight": "model-00014-of-00015.safetensors", "model.layers.79.self_attn.v_proj.weight": "model-00014-of-00015.safetensors", "model.layers.79.self_attn.k_proj.weight": "model-00014-of-00015.safetensors", "model.layers.79.self_attn.q_proj.weight": "model-00014-of-00015.safetensors", "model.layers.79.input_layernorm.weight": "model-00014-of-00015.safetensors", "model.layers.78.mlp.down_proj.weight": "model-00014-of-00015.safetensors", "model.layers.78.mlp.gate_proj.weight": "model-00015-of-00015.safetensors", "model.layers.78.mlp.up_proj.weight": "model-00015-of-00015.safetensors", "model.layers.78.post_attention_layernorm.weight": "model-00015-of-00015.safetensors", "model.layers.78.self_attn.o_proj.weight": "model-00015-of-00015.safetensors", "model.layers.78.input_layernorm.weight": "model-00015-of-00015.safetensors"}}

output-00001-of-00005.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:efffff66ff096265b3367f080b31de1108d69095b2d70cc38a2d2802b1109cc3
+size 8589904788

output-00002-of-00005.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b2bd6ac447d75b7a8bd1c186ff58d857e02f8836d9203efada0bbb7863c7b025
+size 8561313512

output-00003-of-00005.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:649b599361f5d84feae38c7b02e2ca3923b1e54153115860bb16bf7f80fcae91
+size 8574921800

output-00004-of-00005.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dbed125e21a5a904a444e5753f022c019a2ae2f19f29f360ac1947d57519f641
+size 8550070984

output-00005-of-00005.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:08c3e2f7c95d4a48025be5bd0c87188165af98affb428ffda425cf171b66ceb5
+size 5817246572

special_tokens_map.json

@@ -0,0 +1,30 @@
+{
+  "bos_token": {
+    "content": "<s>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "</s>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  }
+}

tokenizer.model

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9e556afd44213b6bd1be2b850ebbbd98f5481437a8021afaf58ee7fb1818d347
+size 499723

tokenizer_config.json

@@ -0,0 +1,42 @@
+{
+  "add_bos_token": true,
+  "add_eos_token": false,
+  "add_prefix_space": true,
+  "added_tokens_decoder": {
+    "0": {
+      "content": "<unk>",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "1": {
+      "content": "<s>",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "2": {
+      "content": "</s>",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "bos_token": "<s>",
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "</s>",
+  "legacy": false,
+  "model_max_length": 1000000000000000019884624838656,
+  "pad_token": "<unk>",
+  "sp_model_kwargs": {},
+  "spaces_between_special_tokens": false,
+  "tokenizer_class": "LlamaTokenizer",
+  "unk_token": "<unk>",
+  "use_default_system_prompt": false
+}