instruction-pretrain's picture

instruction-pretrain

instruction-pretrain

·

https://huggingface.co/papers/2406.14491

DaixuanC45443

AI & ML interests

Synthetic Instructions for Pre-Training

Recent Activity

new activity 8 days ago

instruction-pretrain/finance-Llama3-8B:How large is the corpus size used for pretraining the finance LLaMA?

updated a model 3 months ago

instruction-pretrain/InstructLM-500M

updated a model 3 months ago

instruction-pretrain/InstructLM-1.3B

View all activity

Organizations

None yet

models 5

instruction-pretrain/InstructLM-500M

Text Generation • Updated Mar 4 • 47 • 34

instruction-pretrain/InstructLM-1.3B

Text Generation • Updated Mar 4 • 31 • 42

instruction-pretrain/finance-Llama3-8B

Text Generation • Updated Mar 1 • 91k • 65

instruction-pretrain/medicine-Llama3-8B

Text Generation • Updated Mar 1 • 74 • 38

instruction-pretrain/instruction-synthesizer

Text Generation • Updated Mar 1 • 86 • 78

datasets 3

instruction-pretrain/ft-instruction-synthesizer-collection

Viewer • Updated Mar 1 • 249k • 2.8k • 61

instruction-pretrain/medicine-instruction-augmented-corpora

Preview • Updated Mar 1 • 398 • 13

instruction-pretrain/general-instruction-augmented-corpora

Preview • Updated Mar 1 • 3.32k • 17