Configuration Parsing Warning: In config.json: "quantization_config.bits" must be an integer

Configuration Parsing Warning: In config.json: "quantization_config.bits" must be greater than or equal to 2

Note

This was made to test extremely low quants. 70B is NOT USABLE at 1.2 bpw. I do not recommend using it.

Safetensors

Model size

6.59B params

Tensor type

F16

I16

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for SicariusSicariiStuff/Negative_LLAMA_70B_EXL3_1.2bpw

Base model

Finetuned

Finetuned

Quantized

(14)

this model