ZClip: Adaptive Spike Mitigation for LLM Pre-Training Paper • 2504.02507 • Published 13 days ago • 74 • 2
A Refined Analysis of Massive Activations in LLMs Paper • 2503.22329 • Published 19 days ago • 14 • 3
Variance Control via Weight Rescaling in LLM Pre-training Paper • 2503.17500 • Published 26 days ago • 5 • 2