Hugging Face's logo

mradermacher
/
Dans-PersonalityEngine-V1.2.0-24b-i1-GGUF

Transformers
GGUF
English
general-purpose
roleplay
storywriting
chemistry
biology
code
climate
axolotl
text-generation-inference
finetune
imatrix
conversational
Model card Files
xet
Community
Dans-PersonalityEngine-V1.2.0-24b-i1-GGUF
File size: 8,536 Bytes 
4ad993a
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
81c0b54
 
 
 
 
 
4ad993a
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
 
---
base_model: PocketDoc/Dans-PersonalityEngine-V1.2.0-24b
datasets:
- PocketDoc/Dans-MemoryCore-CoreCurriculum-Small
- AquaV/US-Army-Survival-Sharegpt
- AquaV/Multi-Environment-Operations-Sharegpt
- AquaV/Resistance-Sharegpt
- AquaV/Interrogation-Sharegpt
- AquaV/Chemical-Biological-Safety-Applications-Sharegpt
- AquaV/Energetic-Materials-Sharegpt
- PocketDoc/Dans-Mathmaxx
- PocketDoc/Dans-Mathmaxx-Numina-CoT
- PJMixers/Math-Multiturn-1K-ShareGPT
- PocketDoc/Dans-Benchmaxx-COT
- PocketDoc/Dans-Codemaxx-LeetCode
- PocketDoc/Dans-Codemaxx-CodeFeedback-Conversations
- PocketDoc/Dans-Codemaxx-CodeFeedback-SingleTurn
- PocketDoc/Dans-Codemaxx-Bigcode-SelfInstruct
- PocketDoc/Dans-Taskmaxx
- PocketDoc/Dans-Taskmaxx-DataPrepper
- PocketDoc/Dans-Taskmaxx-ConcurrentQA-Reworked
- PocketDoc/Dans-Taskmaxx-TableGPT
- PocketDoc/Dans-Taskmaxx-SciRIFF
- PocketDoc/Dans-Taskmaxx-Edit
- PocketDoc/Dans-Toolmaxx-Agent
- PocketDoc/Dans-Toolmaxx-ShellCommands
- PocketDoc/Dans-Toolmaxx-Functions-Toolbench
- PocketDoc/Dans-Toolmaxx-Functions-ToolACE
- PocketDoc/Dans-ASCIIMaxx-Wordart
- PocketDoc/Dans-Prosemaxx-Gutenberg
- PocketDoc/Dans-Prosemaxx-Cowriter-3-XL
- PocketDoc/Dans-Prosemaxx-Adventure
- PocketDoc/Dans-Failuremaxx-Adventure-3
- PocketDoc/Dans-Prosemaxx-InstructWriter-ZeroShot-2
- PocketDoc/Dans-Prosemaxx-InstructWriter-Continue-2
- PocketDoc/Dans-Assistantmaxx-Sharegpt
- PocketDoc/Dans-Assistantmaxx-OpenAssistant2
- PocketDoc/Dans-Assistantmaxx-Opus-Merge
- PocketDoc/Dans-Assistantmaxx-sonnetorca-subset
- PocketDoc/Dans-Assistantmaxx-sonnetorca-subset-2
- PocketDoc/Dans-Assistantmaxx-NoRobots
- PocketDoc/Dans-Assistantmaxx-Synthia
- PocketDoc/Dans-Assistantmaxx-ASL
- PocketDoc/Dans-Assistantmaxx-PersonaLLM-Opus
- PocketDoc/Dans-Assistantmaxx-UnnaturalInstructions-GPT4
- PocketDoc/Dans-Assistantmaxx-LongAlign
- PocketDoc/Dans-Assistantmaxx-EvolKit
- PocketDoc/Dans-Assistantmaxx-Camel-GPT4
- PocketDoc/Dans-Assistantmaxx-OpenLeecher-Instruct
- PocketDoc/Dans-Assistantmaxx-Tulu3-IF
- PocketDoc/Dans-Systemmaxx
- PocketDoc/Dans-Logicmaxx-Skunkworks
- PocketDoc/Dans-Logicmaxx-FI-VeriMed
- PocketDoc/Dans-Logicmaxx-SAT-AP
- PocketDoc/Dans-Logicmaxx-Magpie-Ultra
- PJMixers/grimulkan_theory-of-mind-ShareGPT
- PJMixers/grimulkan_physical-reasoning-ShareGPT
- PocketDoc/Dans-Personamaxx
- PocketDoc/Dans-Personamaxx-Rainy
- PocketDoc/Dans-Personamaxx-C1
- PocketDoc/Dans-Personamaxx-VN
language:
- en
library_name: transformers
license: apache-2.0
quantized_by: mradermacher
tags:
- general-purpose
- roleplay
- storywriting
- chemistry
- biology
- code
- climate
- axolotl
- text-generation-inference
- finetune
---
## About

<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type:  -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/PocketDoc/Dans-PersonalityEngine-V1.2.0-24b

<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/Dans-PersonalityEngine-V1.2.0-24b-GGUF
## Usage

If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.

## Provided Quants

(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)

| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Dans-PersonalityEngine-V1.2.0-24b-i1-GGUF/resolve/main/Dans-PersonalityEngine-V1.2.0-24b.i1-IQ1_S.gguf) | i1-IQ1_S | 5.4 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Dans-PersonalityEngine-V1.2.0-24b-i1-GGUF/resolve/main/Dans-PersonalityEngine-V1.2.0-24b.i1-IQ1_M.gguf) | i1-IQ1_M | 5.9 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Dans-PersonalityEngine-V1.2.0-24b-i1-GGUF/resolve/main/Dans-PersonalityEngine-V1.2.0-24b.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 6.6 |  |
| [GGUF](https://huggingface.co/mradermacher/Dans-PersonalityEngine-V1.2.0-24b-i1-GGUF/resolve/main/Dans-PersonalityEngine-V1.2.0-24b.i1-IQ2_XS.gguf) | i1-IQ2_XS | 7.3 |  |
| [GGUF](https://huggingface.co/mradermacher/Dans-PersonalityEngine-V1.2.0-24b-i1-GGUF/resolve/main/Dans-PersonalityEngine-V1.2.0-24b.i1-IQ2_S.gguf) | i1-IQ2_S | 7.6 |  |
| [GGUF](https://huggingface.co/mradermacher/Dans-PersonalityEngine-V1.2.0-24b-i1-GGUF/resolve/main/Dans-PersonalityEngine-V1.2.0-24b.i1-IQ2_M.gguf) | i1-IQ2_M | 8.2 |  |
| [GGUF](https://huggingface.co/mradermacher/Dans-PersonalityEngine-V1.2.0-24b-i1-GGUF/resolve/main/Dans-PersonalityEngine-V1.2.0-24b.i1-Q2_K_S.gguf) | i1-Q2_K_S | 8.4 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Dans-PersonalityEngine-V1.2.0-24b-i1-GGUF/resolve/main/Dans-PersonalityEngine-V1.2.0-24b.i1-Q2_K.gguf) | i1-Q2_K | 9.0 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Dans-PersonalityEngine-V1.2.0-24b-i1-GGUF/resolve/main/Dans-PersonalityEngine-V1.2.0-24b.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 9.4 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Dans-PersonalityEngine-V1.2.0-24b-i1-GGUF/resolve/main/Dans-PersonalityEngine-V1.2.0-24b.i1-IQ3_XS.gguf) | i1-IQ3_XS | 10.0 |  |
| [GGUF](https://huggingface.co/mradermacher/Dans-PersonalityEngine-V1.2.0-24b-i1-GGUF/resolve/main/Dans-PersonalityEngine-V1.2.0-24b.i1-Q3_K_S.gguf) | i1-Q3_K_S | 10.5 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Dans-PersonalityEngine-V1.2.0-24b-i1-GGUF/resolve/main/Dans-PersonalityEngine-V1.2.0-24b.i1-IQ3_S.gguf) | i1-IQ3_S | 10.5 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Dans-PersonalityEngine-V1.2.0-24b-i1-GGUF/resolve/main/Dans-PersonalityEngine-V1.2.0-24b.i1-IQ3_M.gguf) | i1-IQ3_M | 10.8 |  |
| [GGUF](https://huggingface.co/mradermacher/Dans-PersonalityEngine-V1.2.0-24b-i1-GGUF/resolve/main/Dans-PersonalityEngine-V1.2.0-24b.i1-Q3_K_M.gguf) | i1-Q3_K_M | 11.6 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Dans-PersonalityEngine-V1.2.0-24b-i1-GGUF/resolve/main/Dans-PersonalityEngine-V1.2.0-24b.i1-Q3_K_L.gguf) | i1-Q3_K_L | 12.5 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Dans-PersonalityEngine-V1.2.0-24b-i1-GGUF/resolve/main/Dans-PersonalityEngine-V1.2.0-24b.i1-IQ4_XS.gguf) | i1-IQ4_XS | 12.9 |  |
| [GGUF](https://huggingface.co/mradermacher/Dans-PersonalityEngine-V1.2.0-24b-i1-GGUF/resolve/main/Dans-PersonalityEngine-V1.2.0-24b.i1-Q4_0.gguf) | i1-Q4_0 | 13.6 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Dans-PersonalityEngine-V1.2.0-24b-i1-GGUF/resolve/main/Dans-PersonalityEngine-V1.2.0-24b.i1-Q4_K_S.gguf) | i1-Q4_K_S | 13.6 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Dans-PersonalityEngine-V1.2.0-24b-i1-GGUF/resolve/main/Dans-PersonalityEngine-V1.2.0-24b.i1-Q4_K_M.gguf) | i1-Q4_K_M | 14.4 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Dans-PersonalityEngine-V1.2.0-24b-i1-GGUF/resolve/main/Dans-PersonalityEngine-V1.2.0-24b.i1-Q4_1.gguf) | i1-Q4_1 | 15.0 |  |
| [GGUF](https://huggingface.co/mradermacher/Dans-PersonalityEngine-V1.2.0-24b-i1-GGUF/resolve/main/Dans-PersonalityEngine-V1.2.0-24b.i1-Q5_K_S.gguf) | i1-Q5_K_S | 16.4 |  |
| [GGUF](https://huggingface.co/mradermacher/Dans-PersonalityEngine-V1.2.0-24b-i1-GGUF/resolve/main/Dans-PersonalityEngine-V1.2.0-24b.i1-Q5_K_M.gguf) | i1-Q5_K_M | 16.9 |  |
| [GGUF](https://huggingface.co/mradermacher/Dans-PersonalityEngine-V1.2.0-24b-i1-GGUF/resolve/main/Dans-PersonalityEngine-V1.2.0-24b.i1-Q6_K.gguf) | i1-Q6_K | 19.4 | practically like static Q6_K |

Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):

![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)

And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9

## FAQ / Model Request

See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.

## Thanks

I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.

<!-- end -->