-
Language Modeling Is Compression
Paper • 2309.10668 • Published • 83 -
SlimPajama-DC: Understanding Data Combinations for LLM Training
Paper • 2309.10818 • Published • 11 -
Sorted LLaMA: Unlocking the Potential of Intermediate Layers of Large Language Models for Dynamic Inference Using Sorted Fine-Tuning (SoFT)
Paper • 2309.08968 • Published • 23 -
Contrastive Decoding Improves Reasoning in Large Language Models
Paper • 2309.09117 • Published • 39
Lei Wang
demolei
AI & ML interests
LLMs
Recent Activity
upvoted
a
paper
about 9 hours ago
How Much Knowledge Can You Pack into a LoRA Adapter without Harming LLM?
upvoted
a
paper
about 9 hours ago
MLGym: A New Framework and Benchmark for Advancing AI Research Agents
upvoted
a
paper
about 9 hours ago
S*: Test Time Scaling for Code Generation
Organizations
Collections
3
datasets
None public yet