Luigi Sound Team
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -35,3 +35,35 @@ if tokenizer.chat_template is not None:
|
|
35 |
|
36 |
response = generate(model, tokenizer, prompt=prompt, verbose=True)
|
37 |
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
35 |
|
36 |
response = generate(model, tokenizer, prompt=prompt, verbose=True)
|
37 |
```
|
38 |
+
# Original model card
|
39 |
+
|
40 |
+
# Pentiment
|
41 |
+
|
42 |
+

|
43 |
+
[*Submit to silence.*](https://www.youtube.com/watch?v=sduXowC5VzE)
|
44 |
+
|
45 |
+
not too sure how I feel about this one, but yolo! :3
|
46 |
+
Triple stage RP/general tune of Qwen3-30B-A3b Base (finetune, merged for stablization, aligned)
|
47 |
+
|
48 |
+
## Format
|
49 |
+
use chatml. thinking may or may not work, ymmv!.
|
50 |
+
|
51 |
+
## Quants
|
52 |
+
|
53 |
+
GGUF:
|
54 |
+
- todo! :3
|
55 |
+
|
56 |
+
EXL2:
|
57 |
+
- [official quants](https://huggingface.co/collections/allura-quants/q3-30b-a3b-pentiment-exl2-682ee99a9dd5ef944660cf87)
|
58 |
+
|
59 |
+
EXL3:
|
60 |
+
- [official quants](https://huggingface.co/collections/allura-quants/q3-30b-a3b-pentiment-exl3-682e93ab2c106b734c9ee111)
|
61 |
+
|
62 |
+
GPTQ (8bit and 4bit):
|
63 |
+
- [official quants](https://huggingface.co/collections/allura-quants/q3-30b-a3b-pentiment-gptq-682f9c99a7a2441f1a75e510)
|
64 |
+
|
65 |
+
## Thankses
|
66 |
+
special thanks to alibaba for training the base model and regular instruct model, as well as Gryphe for training the pantheon model also used in the merging step. special thanks to artus for making the exllama quants. special thanks to allura for being cute :3
|
67 |
+
|
68 |
+
## Postmortem
|
69 |
+
never merge with qwen 3 instruct. it's not worth it. it will destroy your model and make it just qwen 3 instruct again with all its issues.
|