jarrelscy
/

Mixtral-8x22B-Instruct-v0.1-GPTQ-4bit

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Model Card for Model ID

Optimum GPTQ quantized 8-bit version of Mixtral-8x22B-Instruct-v0.1
See original model card for more information.

How to load

Downloads last month: 15

Safetensors

Model size

19.2B params

Tensor type

I32

·

FP16

·

Inference Providers NEW

Text Generation

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support