Text Generation
Transformers
Safetensors
qwen3_moe
creative
creative writing
fiction writing
plot generation
sub-plot generation
story generation
scene continue
storytelling
fiction story
science fiction
romance
all genres
story
writing
vivid prose
vivid writing
Mixture of Experts
mixture of experts
128 experts
8 active experts
fiction
roleplaying
bfloat16
rp
qwen3
horror
finetune
thinking
reasoning
Merge
conversational
slices: | |
- sources: | |
- model: D:/Qwen3-30B-A3B | |
layer_range: [0, 47] | |
- sources: | |
- model: D:/Qwen3-30B-A3B | |
layer_range: [47, 48] | |
parameters: | |
scale: | |
- filter: o_proj | |
value: 0.3333333333333 | |
- filter: down_proj | |
value: 0.3333333333333 | |
- value: 0.3333333333333 | |
- sources: | |
- model: D:/Qwen3-30B-Pantheon-Proto-RP-1.8-30B-A3B | |
layer_range: [47, 48] | |
parameters: | |
scale: | |
- filter: o_proj | |
value: 0.4444444444444 | |
- filter: down_proj | |
value: 0.4444444444444 | |
- value: 0.4444444444444 | |
- sources: | |
- model: D:/Qwen3-30B-Q3-30B-A3B-Designant | |
layer_range: [47, 48] | |
parameters: | |
scale: | |
- filter: o_proj | |
value: 0.5555555555555 | |
- filter: down_proj | |
value: 0.5555555555555 | |
- value: 0.5555555555555 | |
- sources: | |
- model: D:/Qwen3-30B-A3B-abliterated-erotic | |
layer_range: [47, 48] | |
parameters: | |
scale: | |
- filter: o_proj | |
value: 0.6666666666666 | |
- filter: down_proj | |
value: 0.6666666666666 | |
- value: 0.6666666666666 | |
- sources: | |
- model: D:/Qwen3-30B-A3B | |
layer_range: [47, 48] | |
parameters: | |
scale: | |
- filter: o_proj | |
value: 0.777777777777 | |
- filter: down_proj | |
value: 0.777777777777 | |
- value: 0.888888888888 | |
merge_method: passthrough | |
dtype: bfloat16 | |