Converting Chocolatine Fusion 14B to gguf file

#1
by igordotdev - opened

Hi,
I'm having trouble converting this model using convert_hf_to_gguf file from llama.cpp, also the ollama create command doesn't work.
convert_hf_to_gguf error message:
ValueError: Can not map tensor 'model.layers.0.mlp.down_proj.weight.absmax'
ollama create error message:
Error: unknown data type: U8
Any ideas on how to fix these errors? Does it relate to model infrastructure? Thanks in advance!

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment