Master Undi, we all know what needs to be done.

#3
by MrHillsss - opened

We have faith in your skills.

Lmao thanks

noromaid like moe with the 8B Llama3 , just saying might be really good

Yeah, I have high hopes that this model can be modified to be less censored. I wonder if a ties-merge would be enough, or if a fine tune would be required then a ties-merge. I want to give it a try and see if I can help with this. I have 2x ADA6000 cards (so 96Gb of vram) that I wouldn't mind throwing time at to try and deal with it, then quantize it to fit on one single 48Gb card with 16k context.

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment