ggml-org
/

ultravox-v0_5-llama-3_1-8b-GGUF

Model card Files Files and versions

README.md exists but content is empty.

Downloads last month: 619

GGUF

Model size

8.03B params

Architecture

llama

Hardware compatibility

Log In to view the estimation

4-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including ggml-org/ultravox-v0_5-llama-3_1-8b-GGUF

Multimodal GGUFs

Vision and audio models compatible with llama-server and llama-mtmd-cli • 11 items • Updated 11 days ago • 2