Benchmarking Optimizers for Large Language Model Pretraining Paper • 2509.01440 • Published 4 days ago • 19
FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language Paper • 2506.20920 • Published Jun 26 • 70
zip2zip: Inference-Time Adaptive Vocabularies for Language Models via Token Compression Paper • 2506.01084 • Published Jun 1 • 7
Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluation Paper • 2412.03304 • Published Dec 4, 2024 • 21
The LLM Language Network: A Neuroscientific Approach for Identifying Causally Task-Relevant Units Paper • 2411.02280 • Published Nov 4, 2024 • 1
DRIVINGVQA: Analyzing Visual Chain-of-Thought Reasoning of Vision Language Models in Real-World Scenarios with Driving Theory Tests Paper • 2501.04671 • Published Jan 8
PICLe: Pseudo-Annotations for In-Context Learning in Low-Resource Named Entity Detection Paper • 2412.11923 • Published Dec 16, 2024
Generating Structured Outputs from Language Models: Benchmark and Studies Paper • 2501.10868 • Published Jan 18 • 2
COMET: Commonsense Transformers for Automatic Knowledge Graph Construction Paper • 1906.05317 • Published Jun 12, 2019
Discovering Knowledge-Critical Subnetworks in Pretrained Language Models Paper • 2310.03084 • Published Oct 4, 2023
RECKONING: Reasoning through Dynamic Knowledge Encoding Paper • 2305.06349 • Published May 10, 2023 • 1
Breaking the Language Barrier: Improving Cross-Lingual Reasoning with Structured Self-Attention Paper • 2310.15258 • Published Oct 23, 2023 • 2
CRAB: Assessing the Strength of Causal Relationships Between Real-world Events Paper • 2311.04284 • Published Nov 7, 2023