Luigi Sound Team commited on
Commit
e3457b3
·
verified ·
1 Parent(s): 1e61d80

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +32 -0
README.md CHANGED
@@ -35,3 +35,35 @@ if tokenizer.chat_template is not None:
35
 
36
  response = generate(model, tokenizer, prompt=prompt, verbose=True)
37
  ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
35
 
36
  response = generate(model, tokenizer, prompt=prompt, verbose=True)
37
  ```
38
+ # Original model card
39
+
40
+ # Pentiment
41
+
42
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/634262af8d8089ebaefd410e/tQmu_UoG1AMAIaLSGLXhB.png)
43
+ [*Submit to silence.*](https://www.youtube.com/watch?v=sduXowC5VzE)
44
+
45
+ not too sure how I feel about this one, but yolo! :3
46
+ Triple stage RP/general tune of Qwen3-30B-A3b Base (finetune, merged for stablization, aligned)
47
+
48
+ ## Format
49
+ use chatml. thinking may or may not work, ymmv!.
50
+
51
+ ## Quants
52
+
53
+ GGUF:
54
+ - todo! :3
55
+
56
+ EXL2:
57
+ - [official quants](https://huggingface.co/collections/allura-quants/q3-30b-a3b-pentiment-exl2-682ee99a9dd5ef944660cf87)
58
+
59
+ EXL3:
60
+ - [official quants](https://huggingface.co/collections/allura-quants/q3-30b-a3b-pentiment-exl3-682e93ab2c106b734c9ee111)
61
+
62
+ GPTQ (8bit and 4bit):
63
+ - [official quants](https://huggingface.co/collections/allura-quants/q3-30b-a3b-pentiment-gptq-682f9c99a7a2441f1a75e510)
64
+
65
+ ## Thankses
66
+ special thanks to alibaba for training the base model and regular instruct model, as well as Gryphe for training the pantheon model also used in the merging step. special thanks to artus for making the exllama quants. special thanks to allura for being cute :3
67
+
68
+ ## Postmortem
69
+ never merge with qwen 3 instruct. it's not worth it. it will destroy your model and make it just qwen 3 instruct again with all its issues.