Qwen2.5-VL-72B-Instruct-mmproj-f16.gguf is broken
#4
by
hp1337
- opened
I get gibberish with this file, and normal output with the ggml-org version of the file.
The mmproj in this repo is old now. It was built with git clone https://github.com/HimariO/llama.cpp.qwen2vl.git
cd llama.cpp.qwen2vl
git checkout qwen25-vl-20250404 . I will update . Where is the ggml-org version of this file . I looked here https://huggingface.co/ggml-org/Qwen2.5-VL-72B-Instruct-GGUF/tree/main no mmproj file.
My server is busy creating ggufs so I have uploaded new version of mmproj files taken from bartowski (reliable source) https://huggingface.co/bartowski/Qwen_Qwen2.5-VL-72B-Instruct-GGUF.
This comment has been hidden (marked as Spam)
Error: 400:
That is a html error code or?
Mungert
changed discussion status to
closed