MixLLM: LLM Quantization with Global Mixed-precision between Output-features and Highly-efficient System Design
Paper
•
2412.14590
•
Published
•
14
MikeO
olborer
AI & ML interests
None yet
Organizations
None yet