GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers
Paper • 2210.17323 • Published • 12
# No code snippets available yet for this library.
# To use this model, check the repository files and the library's documentation.
# Want to help? PRs adding snippets are welcome at:
# https://github.com/huggingface/huggingface.js4-bit GPTQ quantized version of openhands-lm-7b-v0.1 for use with the Private LLM app.
- Downloads last month
- -
Model tree for numen-tech/openhands-lm-7b-v0.1-GPTQ-Int4
Base model
Qwen/Qwen2.5-7B Finetuned
Qwen/Qwen2.5-Coder-7B Finetuned
Qwen/Qwen2.5-Coder-7B-Instruct Finetuned
OpenHands/openhands-lm-7b-v0.1