Entropy-Guided Attention for Private LLMs
Paper
•
2501.03489
•
Published
•
13
•
8
Lee Gao
leegao19
AI & ML interests
None yet
Recent Activity
commented on
a paper
3 days ago
Entropy-Guided Attention for Private LLMs
upvoted
a
paper
6 days ago
Towards System 2 Reasoning in LLMs: Learning How to Think With Meta
Chain-of-Though
upvoted
a
paper
6 days ago
Entropy-Guided Attention for Private LLMs
Organizations
leegao19's activity
commented
a
paper
3 days ago
commented
a
paper
6 days ago
commented
3
papers
14 days ago
Fourier Position Embedding: Enhancing Attention's Periodic Extension for Length Generalization
Paper
•
2412.17739
•
Published
•
39
•
26
Fourier Position Embedding: Enhancing Attention's Periodic Extension for Length Generalization
Paper
•
2412.17739
•
Published
•
39
•
26
Breaking the Stage Barrier: A Novel Single-Stage Approach to Long Context Extension for Large Language Models
Paper
•
2412.07171
•
Published
•
1
•
1
commented
3
papers
15 days ago
Rethinking Addressing in Language Models via Contexualized Equivariant Positional Encoding
Paper
•
2501.00712
•
Published
•
6
•
4
Deliberation in Latent Space via Differentiable Cache Augmentation
Paper
•
2412.17747
•
Published
•
29
•
5
Fourier Position Embedding: Enhancing Attention's Periodic Extension for Length Generalization
Paper
•
2412.17739
•
Published
•
39
•
26
commented
a
paper
4 months ago
commented
7
papers
10 months ago
MoAI: Mixture of All Intelligence for Large Language and Vision Models
Paper
•
2403.07508
•
Published
•
75
•
7
Simple linear attention language models balance the recall-throughput tradeoff
Paper
•
2402.18668
•
Published
•
19
•
12
MoAI: Mixture of All Intelligence for Large Language and Vision Models
Paper
•
2403.07508
•
Published
•
75
•
7
Simple linear attention language models balance the recall-throughput tradeoff
Paper
•
2402.18668
•
Published
•
19
•
12
Simple linear attention language models balance the recall-throughput tradeoff
Paper
•
2402.18668
•
Published
•
19
•
12
Simple linear attention language models balance the recall-throughput tradeoff
Paper
•
2402.18668
•
Published
•
19
•
12
GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
Paper
•
2403.03507
•
Published
•
184
•
15
commented
4
papers
11 months ago
GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
Paper
•
2403.03507
•
Published
•
184
•
15
Yi: Open Foundation Models by 01.AI
Paper
•
2403.04652
•
Published
•
62
•
3
GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
Paper
•
2403.03507
•
Published
•
184
•
15
Resonance RoPE: Improving Context Length Generalization of Large Language Models
Paper
•
2403.00071
•
Published
•
23
•
2