Upload README.md

README.md

@@ -1,3 +1,79 @@
----
-license: llama3.3
----
+---
+base_model:
+- nbeerbower/Llama-3.1-Nemotron-lorablated-70B
+- ArliAI/Llama-3.1-70B-ArliAI-RPMax-v1.3
+- TheDrummer/Fallen-Llama-3.3-R1-70B-v1
+- EVA-UNIT-01/EVA-LLaMA-3.33-70B-v0.1
+- SicariusSicariiStuff/Negative_LLAMA_70B
+- LatitudeGames/Wayfarer-Large-70B-Llama-3.3
+library_name: transformers
+tags:
+- mergekit
+- merge
+license: llama3.3
+---
+
+![image/png](https://cdn-uploads.huggingface.co/production/uploads/64909c086073a0cd172d0411/KK8hCbd8KXy03cP_qzdij.png)
+
+V2 of Dungeonmaster, I decided to move away from the R1 base here, because I feel it the pros dont necessarily outweigh the cons. For V2 I decided to go for the classic nbeerbower/Llama-3.1-Nemotron-lorablated-70B as the base.
+Dungeonmaster is meant to be specifically for creative roleplays with stakes and consequences using the following curated models:
+
+- LatitudeGames/Wayfarer-Large-70B-Llama-3.3 - A fine-tuned model specifically designed for this very application.
+- ArliAI/Llama-3.1-70B-ArliAI-RPMax-v1.3 - Another fine-tuned trained on RP datasets.
+- EVA-UNIT-01/EVA-LLaMA-3.33-70B-v0.1 - For it's strong descriptive writing.
+- SicariusSicariiStuff/Negative_LLAMA_70B - To assist with the darker undertones.
+- TheDrummer/Fallen-Llama-3.3-R1-70B-v1 - The secret sauce, a completely unhinged thinking model that turns things up to 11.
+
+# merge
+
+This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
+
+## Merge Details
+### Merge Method
+
+This model was merged using the [Linear DELLA](https://arxiv.org/abs/2406.11617) merge method using [nbeerbower/Llama-3.1-Nemotron-lorablated-70B](https://huggingface.co/nbeerbower/Llama-3.1-Nemotron-lorablated-70B) as a base.
+
+### Models Merged
+
+The following models were included in the merge:
+* [ArliAI/Llama-3.1-70B-ArliAI-RPMax-v1.3](https://huggingface.co/ArliAI/Llama-3.1-70B-ArliAI-RPMax-v1.3)
+* [TheDrummer/Fallen-Llama-3.3-R1-70B-v1](https://huggingface.co/TheDrummer/Fallen-Llama-3.3-R1-70B-v1)
+* [EVA-UNIT-01/EVA-LLaMA-3.33-70B-v0.1](https://huggingface.co/EVA-UNIT-01/EVA-LLaMA-3.33-70B-v0.1)
+* [SicariusSicariiStuff/Negative_LLAMA_70B](https://huggingface.co/SicariusSicariiStuff/Negative_LLAMA_70B)
+* [LatitudeGames/Wayfarer-Large-70B-Llama-3.3](https://huggingface.co/LatitudeGames/Wayfarer-Large-70B-Llama-3.3)
+
+### Configuration
+
+The following YAML configuration was used to produce this model:
+
+```yaml
+models:
+  - model: LatitudeGames/Wayfarer-Large-70B-Llama-3.3
+    parameters:
+      weight: 0.20
+      density: 0.7
+  - model: ArliAI/Llama-3.1-70B-ArliAI-RPMax-v1.3
+    parameters:
+      weight: 0.20
+      density: 0.7
+  - model: EVA-UNIT-01/EVA-LLaMA-3.33-70B-v0.1
+    parameters:
+      weight: 0.20
+      density: 0.7
+  - model: SicariusSicariiStuff/Negative_LLAMA_70B
+    parameters:
+      weight: 0.20
+      density: 0.7
+  - model: TheDrummer/Fallen-Llama-3.3-R1-70B-v1
+    parameters:
+      weight: 0.20
+      density: 0.7
+merge_method: della_linear
+base_model: nbeerbower/Llama-3.1-Nemotron-lorablated-70B
+parameters:
+  epsilon: 0.2
+  lambda: 1.1
+dtype: bfloat16
+tokenizer:
+ source: nbeerbower/Llama-3.1-Nemotron-lorablated-70B
+```