Non readable response when using image
#1
by
Ali4ai
- opened
when run with llama-server version : llama-b6314-bin-win-vulkan-x64
llama-server -m .\MiniCPM-V-4_5-Q4_K_M.gguf --mmproj .\MiniCPM-V-4_5-mmproj-f16.gguf -c 8000 -ngl 10
Getting similar issues while using llama-server -hf second-state/MiniCPM-V-4_5-GGUF:Q5_K_M
how do you just start llama-server with --mmproj argument ? i built it from source and see "error: invalid argument: --mmproj".
and "llama-llava-cli -m MiniCPM-V-4_5-Q4_K_M.gguf --mmproj MiniCPM-V-4_5-mmproj-f16.gguf --image 111.png --prompt "Describe image in detail." -c 8000 -ngl 10" return nothing without any error.