Configuration Parsing Warning: In config.json: "quantization_config.bits" must be an integer

Pentiment

Safetensors

Model size

7.03B params

Tensor type

F16

I16

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for allura-quants/allura-org_Q3-30b-A3b-Pentiment_EXL3_3.5bpw_H6

Base model

Finetuned

Quantized

(23)

this model