Text Generation
GGUF
English
llama-3
llama3
llama
bfloat16
uncensored
all use cases
creative use cases
creative
creative writing
fiction writing
plot generation
sub-plot generation
story generation
scene continue
storytelling
fiction story
science fiction
romance
all genres
story
writing
vivid prose
vivid writing
fiction
roleplaying
swearing
rp
GGUFs
Merge
conversational
Good for phone?
#1
by
Fishtiks
- opened
I've been playing with ChatterUI. I haven't tried a lot of models, and I realize this is big, but I'm looking for one to maybe replace Llama 3.2 3B Instruct uncensored for prompts on ChatterUI. Is this adaptable to that, or would you predict it wouldn't turn out? I was surprised to see the one I chose work, and well, but I very much like the features on this one and would likely see it as an upgrade. I just wouldn't waste the bandwidth and time if you told me it probably wouldn't work.
It should work well ; it will definitely give you a different experience because of the model mix (2 mixed 3Bs) plus the Brainstorm 40x adapter.
However, it is 81 layers - which means more processing time / lower t/s .
(reg 3B is 28 layers)