Hydragen: High-Throughput LLM Inference with Shared Prefixes
Paper
•
2402.05099
•
Published
•
20
Charles Earl
charlescearl
·
AI & ML interests
Classification, summarization, fairness and transparency
Organizations
None yet
upvoted
a
paper
over 1 year ago