TheYuriLover
/

airoboros-13b-gpt4-1.4-GPTQ-32g-ao-ts

Text Generation

text-generation-inference

Model card Files Files and versions Community

YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

This is the gptq 4bit quantization of this model: https://huggingface.co/jondurbin/airoboros-13b-gpt4-1.4

This quantization was made by using this repository: https://github.com/qwopqwop200/GPTQ-for-LLaMa/tree/triton

And I used the triton branch with all the gptq implementations available (true_sequential + act_order + groupsize 32)

Downloads last month: 16

Inference Providers NEW

Text Generation

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support