4.65 bits/bpw quantization of sheep-duck-llama-2 (https://huggingface.co/Riiid/sheep-duck-llama-2) with exllamav2.
Update on 21/09/2023: Re-did the quant with newest exllamav2 version, which fixed some measurement issues.
- Downloads last month
- 7
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support