Article
Introducing AutoRound: Intel’s Advanced Quantization for LLMs and VLMs
By
and 8 others
•
•
19wenhua cheng
wenhuach
AI & ML interests
Model Compression, CV
Recent Activity
upvoted
an
article
6 days ago
Introducing AutoRound: Intel’s Advanced Quantization for LLMs and VLMs
posted
an
update
6 days ago
AutoRound(https://github.com/intel/auto-round) has been integrated into Transformers, allowing you to run AutoRound-formatted models directly in the upcoming release. Additionally, we are actively working on supporting the GGUF double-quant format, e.g. q4_k_s, stay tuned!
https://huggingface.co/blog/autoround
published
an
article
7 days ago
Introducing AutoRound: Intel’s Advanced Quantization for LLMs and VLMs
Organizations
