L3.3-Damascus-R1 - EXL2 7.0bpw

This is a 7.0bpw EXL2 quant of Steelskull/L3.3-Damascus-R1

Details about the model can be found at the above model page.

Perplexity Scoring

Below are the perplexity scores for the EXL2 models. A lower score is better.

Quant Level Perplexity Score
5.0 4.6682
4.5 4.7686
4.0 4.9222
3.5 5.2946
3.0 6.5971
2.75 8.3347
2.5 9.1701
2.25 10.6287
Downloads last month
3
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.

Model tree for Dracones/L3.3-Damascus-R1_exl2_7.0bpw

Quantized
(15)
this model