https://huggingface.co/mobiuslabsgmbh/DeepSeek-R1-ReDistill-Llama3-8B-v1.1

#596
by Laetilia - opened

This is peculiar distillation of distillation of R1.
Authors claim generally better performance than DeepSeek's own R1 to Llama3-8B distillation.
Please, if that's alright, quantize it to GGUFs, so it would be much more convenient for people to test and perhaps to use.

Sure, no problem. It's queued, and if all goes well, should be done in a few hours at most. You can watch the progress at http://hf.tst.eu/status.html

Cheers!

mradermacher changed discussion status to closed
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment