Quantized using the default exllamav3 (0.0.4) quantization process.


EXL3 quants available:

  • 4.0bpw, 6.0bpw
  • Go to "Files and versions", then click on "Main" to choose your quant
Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for s1arsky/IceLemonMedovukhaRP-7b-EXL3