Configuration Parsing Warning: In config.json: "quantization_config.bits" must be an integer

L3.3-Damascus-R1 - EXL2 2.75bpw

This is a 2.75bpw EXL2 quant of Steelskull/L3.3-Damascus-R1

Details about the model can be found at the above model page.

Perplexity Scoring

Below are the perplexity scores for the EXL2 models. A lower score is better.

Quant Level Perplexity Score
5.0 4.6682
4.5 4.7686
4.0 4.9222
3.5 5.2946
3.0 6.5971
2.75 8.3347
2.5 9.1701
2.25 10.6287
Downloads last month
7
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for Dracones/L3.3-Damascus-R1_exl2_2.75bpw

Quantized
(16)
this model