File size: 4,701 Bytes
4800712 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 |
---
base_model:
- Sao10K/L3.3-70B-Euryale-v2.3
- nbeerbower/Llama-3.1-Nemotron-lorablated-70B
- EVA-UNIT-01/EVA-LLaMA-3.33-70B-v0.1
- SicariusSicariiStuff/Negative_LLAMA_70B
- TheDrummer/Anubis-70B-v1
library_name: transformers
tags:
- mergekit
- merge
---
<!DOCTYPE html>
<style>
body {
font-family: 'Quicksand', sans-serif;
background: linear-gradient(135deg, #2A0A2A 0%, #1A0025 100%);
color: #E5B8FF;
margin: 0;
padding: 0;
font-size: 16px;
}
.container {
margin: 20px;
background-color: rgba(89, 0, 255, 0.05);
padding: 20px;
border-radius: 12px;
box-shadow: 0 4px 20px rgba(255, 0, 255, 0.15);
backdrop-filter: blur(10px);
border: 1px solid rgba(255, 0, 255, 0.2);
}
.header h1 {
font-size: 28px;
color: #FF00FF;
margin: 0 0 20px 0;
text-shadow: 0 0 10px rgba(255, 0, 255, 0.5);
}
.update-section {
margin-top: 30px;
}
.update-section h2 {
font-size: 24px;
color: #00FFFF;
}
.update-section p {
font-size: 16px;
line-height: 1.6;
color: #E5B8FF;
}
.info img {
width: 100%;
border-radius: 10px;
margin-bottom: 15px;
box-shadow: 0 0 20px rgba(255, 0, 255, 0.3);
}
a {
color: #00FFFF;
text-decoration: none;
transition: color 0.3s ease;
}
a:hover {
color: #FF00FF;
}
.button {
display: inline-block;
background-color: #9000FF;
color: #FFFFFF;
padding: 10px 20px;
border-radius: 5px;
cursor: pointer;
text-decoration: none;
border: 1px solid rgba(255, 0, 255, 0.3);
}
.button:hover {
background-color: #FF00FF;
box-shadow: 0 0 15px rgba(255, 0, 255, 0.5);
}
pre {
background-color: rgba(89, 0, 255, 0.1);
padding: 15px;
border-radius: 5px;
overflow-x: auto;
border: 1px solid rgba(255, 0, 255, 0.2);
}
code {
font-family: 'Courier New', monospace;
color: #E5B8FF;
}
</style>
<html lang="en">
<head>
<meta charset="UTF-8">
<meta name="viewport" content="width=device-width, initial-scale=1.0">
<title>L3.3-MS-Nevoria-70B</title>
<link href="https://fonts.googleapis.com/css2?family=Quicksand:wght@400;500;600&display=swap" rel="stylesheet">
</head>
<body>
<div class="container">
<div class="header">
<h1>L3.3-MS-Nevoria-70B</h1>
</div>
<div class="info">
<img src="https://cdn-uploads.huggingface.co/production/uploads/64545af5ec40bbbd01242ca6/dtlCF4LbekmDD2y3LNpdH.jpeg" alt="Model banner">
<p></p>
<p><strong>Creator:</strong> <a href="https://huggingface.co/Steelskull" target="_blank">SteelSkull</a></p>
<h2>About Nevoria-70B:</h2>
<pre><code>Name Legend:
L3.1 = Llama 3.1
MS = Model Stock
Nevoria = mix of EVA-LLAMA-0.1, EURYALE-v2.3, Anubis-v1, and Negative_LLAMA
70B = 70B parameter model</code></pre>
<p>This model was created as I liked the storytelling of EVA, the prose and details of scenes from EURYALE and Anubis, enhanced with Negative_LLAMA to kill off the positive bias with a touch of nemotron sprinkeled in. </p>
<p>The choice to use the lorablated model as a base was intentional - while it might seem counterintuitive, this approach creates unique interactions between the weights, similar to what was achieved in the original <a href="https://huggingface.co/Steelskull/L3-MS-Astoria-70b" target="_blank">Astoria model</a> and <a href="https://huggingface.co/Steelskull/L3.1-MS-Astoria-70b-v2" target="_blank">Astoria V2 model</a> . Rather than simply removing refusals, this "weight twisting" effect that occurs when subtracting the lorablated base model from the other models during the merge process creates an interesting balance in the final model's behavior. While this approach differs from traditional sequential application of components, it was chosen for its unique characteristics in the model's responses.</p>
<h2>Recommended Templates / System Prompts:</h2>
<p><a href="https://huggingface.co/Konnect1221/Methception-Llamaception-SillyTavern-Preset" target="_blank">LLam@ception</a> - Template/System prompt [Made by @.konnect]</p>
<h2>Quantized Versions: (Will be added once done/found)</h2>
<p>GGUF Quantizations:</p>
<ul>
</ul>
<h2>Configuration:</h2>
<pre><code>MODEL_NAME = "L3.3-MS-Nevoria-70B"
base_model: nbeerbower/Llama-3.1-Nemotron-lorablated-70B
merge_method: model_stock
dtype: bfloat16
models:
- model: EVA-UNIT-01/EVA-LLaMA-3.33-70B-v0.1
- model: Sao10K/L3.3-70B-Euryale-v2.3
- model: TheDrummer/Anubis-70B-v1
- model: SicariusSicariiStuff/Negative_LLAMA_70B</code></pre>
<div class="support-section">
<h2>Support the Project:</h2>
<a href="https://ko-fi.com/Y8Y0AO2XE" target="_blank" class="button">
Support on Ko-fi
</a>
</div>
</div>
</div>
</body>
</html> |