Configuration Parsing Warning: In config.json: "quantization_config.bits" must be an integer

Note

This was made to test extremely low quants. 70B is usable at 2.15 bpw. A custom strategy for quanting was used, for details check EXL3 repo.

Safetensors

Model size

10.8B params

Tensor type

F16

I16

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for SicariusSicariiStuff/Negative_LLAMA_70B_EXL3_d_2.15bpw

Base model

Finetuned

Finetuned

Quantized

(14)

this model