Hugging Face's logo

Yhyu13
/
LMCocktail-10.7B-v1

Text Generation
Transformers
Safetensors
llama
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
3

Quant pls

#1
by Yhyu13 - opened
Discussion
Yhyu13
 Owner

@LoneStriker @TheBloke

Hi, folks.

I tried a new llm merging technique backed by a paper called lm cocktail. Here is the result model I get from merging #1 and #2 on the current open llm leaderboard.

The test result looks promising. Would you like to quant this one?

Thanks!

LoneStriker

I'll add it to the queue.

LoneStriker

Quants here: https://huggingface.co/LoneStriker?sort_models=created&search_models=lmcocktail#models

Yhyu13
 Owner

Quants here: https://huggingface.co/LoneStriker?sort_models=created&search_models=lmcocktail#models

Thanks!

TheBloke

Sorry, didn't see this. For future, if I don't respond could you put it on my Discord #model-requests channel?

Doing it now

Yhyu13 changed discussion status to closed

Sign up or log in to comment