Article
Efficient LLM Pretraining: Packed Sequences and Masked Attention
By
•
•
43Lukas
sirluk
AI & ML interests
None yet
Recent Activity
upvoted
an
article
about 1 month ago
xLSTM-based time series model TiRex significantly outperforms competing models in forecasting accuracy
commented on
their
article
about 2 months ago
Efficient LLM Pretraining: Packed Sequences and Masked Attention
commented on
their
article
3 months ago
Efficient LLM Pretraining: Packed Sequences and Masked Attention
Organizations
published
an
article
9 months ago
published
an
article
over 1 year ago
Article
Multilabel Classification using Mistral-7B on a single GPU with quantization and LoRA
By
•
•
23