Excellent work.

#1
by DavidAU - opened

Curious if tech could be used on Llama 3.1 8Bs?
and/or "older" Mistral 7Bs? Solar 10.7B?

Could push the older Llamas just that much further...;

Llama 3.2 3Bs ?

Again ; excellent work.

PS: Just built some 46B Mistrals 2506-Instructs ; gonna push the creativity to the max.

Yep, the method can be used to unslop any model that works with vllm.

Sign up or log in to comment