INT-FP-QSim: Mixed Precision and Formats For Large Language Models and Vision Transformers
Paper
•
2307.03712
•
Published
•
1
Transformers
This collection is for Transformer Articles
-
-
Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
Paper • 2408.04093 • Published • 4 -
Arcee's MergeKit: A Toolkit for Merging Large Language Models
Paper • 2403.13257 • Published • 20 -
LongVILA: Scaling Long-Context Visual Language Models for Long Videos
Paper • 2408.10188 • Published • 53 -
Emu3: Next-Token Prediction is All You Need
Paper • 2409.18869 • Published • 95 -
m2mKD: Module-to-Module Knowledge Distillation for Modular Transformers
Paper • 2402.16918 • Published -
Scaling Transformers for Low-Bitrate High-Quality Speech Coding
Paper • 2411.19842 • Published • 12 -
Monet: Mixture of Monosemantic Experts for Transformers
Paper • 2412.04139 • Published • 13