ggml_bakllava-1

This repo contains GGUF files to inference BakLLaVA-1 with llama.cpp end-to-end without any extra dependency.

Note: The mmproj-model-f16.gguf file structure is experimental and may change. Always use the latest code in llama.cpp.

Downloads last month
15,642
GGUF
Model size
7.24B params
Architecture
llama

4-bit

5-bit

16-bit

Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.

Space using mys/ggml_bakllava-1 1