Transformer^2: Self-adaptive LLMs
Paper
•
2501.06252
•
Published
•
53
Papers
-
-
s1: Simple test-time scaling
Paper • 2501.19393 • Published • 112 -
Can 1B LLM Surpass 405B LLM? Rethinking Compute-Optimal Test-Time Scaling
Paper • 2502.06703 • Published • 143 -
Parameters vs FLOPs: Scaling Laws for Optimal Sparsity for Mixture-of-Experts Language Models
Paper • 2501.12370 • Published • 11 -
Self-Refine: Iterative Refinement with Self-Feedback
Paper • 2303.17651 • Published • 2 -
Probing-RAG: Self-Probing to Guide Language Models in Selective Document Retrieval
Paper • 2410.13339 • Published -
Gorilla: Large Language Model Connected with Massive APIs
Paper • 2305.15334 • Published • 5 -
PERL: Parameter Efficient Reinforcement Learning from Human Feedback
Paper • 2403.10704 • Published • 58 -
Towards Optimal Learning of Language Models
Paper • 2402.17759 • Published • 18 -
GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
Paper • 2403.03507 • Published • 188 -
MoAI: Mixture of All Intelligence for Large Language and Vision Models
Paper • 2403.07508 • Published • 76 -
Probing Out-of-Distribution Robustness of Language Models with Parameter-Efficient Transfer Learning
Paper • 2301.11660 • Published • 1 -
From RAGs to rich parameters: Probing how language models utilize external knowledge over parametric information for factual queries
Paper • 2406.12824 • Published • 21 -
Scaling and evaluating sparse autoencoders
Paper • 2406.04093 • Published • 3 -
DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understanding
Paper • 2412.10302 • Published • 17 -
LLM Post-Training: A Deep Dive into Reasoning Large Language Models
Paper • 2502.21321 • Published -
Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey
Paper • 2503.12605 • Published • 25 -
R1-VL: Learning to Reason with Multimodal Large Language Models via Step-wise Group Relative Policy Optimization
Paper • 2503.12937 • Published • 23 -
Beyond Reward Hacking: Causal Rewards for Large Language Model Alignment
Paper • 2501.09620 • Published