Download command wrong
#1
by
DuckyBlender
- opened
The model filename is falcon-mamba-7B-instruct-Q4_K_M.gguf
This is the correct command:
huggingface-cli download tiiuae/falcon-mamba-7b-instruct-Q4_K_M-GGUF --include falcon-mamba-7B-instruct-Q4_K_M.gguf --local-dir ./
Also this is wrong:
./llama-cli -m falcon-mamba-instruct-Q4_K_M.gguf -p "Hello how are you?"
Should be
./llama-cli -m falcon-mamba-7b-instruct-Q4_K_M-GGUF -p "Hello how are you?"
Thank you, I just fixed it in the README
ybelkada
changed discussion status to
closed