Sigma: Differential Rescaling of Query, Key and Value for Efficient Language Models
Paper
•
2501.13629
•
Published
•
49
Hang Li
hanglics
AI & ML interests
NLP, Conversational Search, Relevance Feedback, Information Retrieval, ML
Organizations
authored
a
paper
6 months ago
authored
a
paper
7 months ago