Zayd Muhammad Kawakibi Zuhri PRO

zaydzuhri's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

commented 3 papers about 1 month ago

Softpick: No Attention Sink, No Massive Activations with Rectified Softmax

Paper • 2504.20966 • Published Apr 29 • 31 •

5

Softpick: No Attention Sink, No Massive Activations with Rectified Softmax

Paper • 2504.20966 • Published Apr 29 • 31 •

5

Softpick: No Attention Sink, No Massive Activations with Rectified Softmax

Paper • 2504.20966 • Published Apr 29 • 31 •

5

commented a paper 12 months ago

MLKV: Multi-Layer Key-Value Heads for Memory Efficient Transformer Decoding

Paper • 2406.09297 • Published Jun 13, 2024 • 6 •

2