Discord
I have a RTX 3060 12GB and wanted to know which model of yours would you suggest for conversation and sentence generation, that would fit that specific GPU. You have many models and seem very knowledgeable about all of this. Figured I'd just ask.
Hi
Please clarify what type of sentence / conversation - all the LLMs/AIs can do this , I just need an idea of what "flavor(s)" you are looking for.
Roughly for conversation - "chat" - I would recommended the less "creative models" - or class 1 and class 2, as these are more stable for multi-turn chat.
Sentences and conversations by CEFR level that include the exact {word} at least once. A1, A2, B1, B2, C1, C2.
Sentences would be 20 sentences preceded by the CEFR heading
A1
[sentence]
[sentence]
[sentence]
Conversations would be at most 20 conversations per CEFR level that include the exact {word} at least once. 1 CEFR level per output. A1-A2 would get 2 speakers at 4 total sentences. B1-C2 would get more speakers up to 4.
A1 - A2
[speaker1:]
[speaker2:]
[speaker1:]
[speaker2:]
B1-C2
[speaker1:]
[speaker2:]
[speaker3:]
[speaker4:]
[speaker2:]
[speaker1:]
[speaker3:]
I just wanted to run this at home instead of having to use ChatGPT. I wanted an uncensored version because it would hopefully provide better text generation and should just follow my instructions when ChatGPT would say I can't give you the sentences for pee at A1 because that's not an A1 word. I don't care just do it, you're the computer why are you telling me no. I get that all the AI can do this but I wanted one that is better at creative writing. I don't need a chatbot. I just need to feed it a que of prompts and get the output back in a txt file which I can figure out on my own.
Hmm ; I would go with Gemma the Writer (and related models). These are not an "uncensored" as some models, however your instruction requirements are unique and Gemma is very good at prose level instruction - that is actually following them.
If I understand your requirements, Gemma models will be a good place to start to hone your instructions to the LLM/AI first.
They maybe use other model(s) that are more uncensored after this...
Otherwise you might be fighting two battles, instead of one to begin with.
Thanks I'll try that out. Much respect.