Thank you
Thank you very very much for the abliterated model! Would be interesting to see if it does better in benchmarks without the lobotomization :-)
i did read you are also working on abliterating the multimodal models. That might get a little difficult and i think it might be possible to lock the input and output and do only 1 expert at a time. (Just how i would go about it)
After you did finnish with abliterating other Qwen Models and the MoE models , would you mind to share the code you used?
Best regards
Thanks for the great Feedback! the Gemma 3 (with the vision adapter) models have actually been abliterated, but Ive lost the OG (only ablierated model), after the finetune, I fine-tuned most of these models on Custom Family data and to work specifically with OpenAI. As for the code, I used a different (custom) custom algorithm I developed, It will essentially be released along with a research paper, but that will take a long time (at earliest Q4 this year).