Supa-AI/Mixtral-8x22B-v0.1-gguf
This model was converted to GGUF format from mistralai/Mixtral-8x22B-v0.1 using llama.cpp.
Refer to the original model card for more details on the model.
Available Versions
Use with llama.cpp
Replace FILENAME with one of the above filenames.
CLI:
llama-cli --hf-repo Supa-AI/Mixtral-8x22B-v0.1-gguf --hf-file FILENAME -p "Your prompt here"
Server:
llama-server --hf-repo Supa-AI/Mixtral-8x22B-v0.1-gguf --hf-file FILENAME -c 2048
Model Details
- Original Model: mistralai/Mixtral-8x22B-v0.1
- Format: GGUF
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no library tag.
Model tree for Supa-AI/Mixtral-8x22B-v0.1-gguf
Base model
mistralai/Mixtral-8x22B-v0.1