YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

Mixtral-8x7B-Instruct-v0.1-FP8-v1

Weights and activations are per-tensor quantized to float8_e4m3.
Quantization with AutoFP8.
Calibration dataset: Ultrachat (mgoin/ultrachat_2k)
Samples: 1024
Sequence length: 8192

Evaluation

TBA

Downloads last month: 4

Safetensors

Model size

46.7B params

Tensor type

BF16

F8_E4M3

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.