LLM Training Datasets

sugatoray 's Collections

RLMs (Reasoning Language Models)

Books And Notes

Reasoning Datasets

SmolAgents Tools (Spaces)

Document AI

Bookmark::Models

LLMs

LLM Tools

AV LLMs

LLM Training Datasets

Papers

Leaderboards 🔥

Papers-MoE

Papers-LLMEval

LLM LLAMA3

Papers-Fundamentals

TFM: TimeSeries Foundation Models

Papers-Benchmarks

LLMs-EmbeddingModels

LLMs + Mamba

LLM + Datasets : Finance

updated 7 days ago

A collection of datasets for training LLMs.

Upvote

HuggingFaceTB/cosmopedia

Viewer • Updated Aug 12, 2024 • 31.1M • 22.8k • 591
fka/awesome-chatgpt-prompts

Viewer • Updated Jan 6 • 203 • 11.5k • 7.61k
HuggingFaceTB/cosmopedia-100k

Viewer • Updated Feb 19, 2024 • 100k • 879 • 41
CohereForAI/aya_dataset

Viewer • Updated Jun 28, 2024 • 206k • 2.34k • 299
m-a-p/Code-Feedback

Viewer • Updated Feb 26, 2024 • 66.4k • 342 • 206
nvidia/OpenMathInstruct-1

Viewer • Updated Feb 16, 2024 • 6.08M • 580 • 224
teknium/OpenHermes-2.5

Viewer • Updated Apr 15, 2024 • 1M • 2.1k • 718
Anthropic/hh-rlhf

Viewer • Updated May 26, 2023 • 169k • 13.1k • 1.29k
Open-Orca/OpenOrca

Viewer • Updated 19 days ago • 2.94M • 11.2k • 1.37k
stingning/ultrachat

Viewer • Updated Feb 22, 2024 • 774k • 1.66k • 435
tiiuae/falcon-refinedweb

Viewer • Updated Jun 20, 2023 • 968M • 52.7k • 840
liuhaotian/LLaVA-Instruct-150K

Preview • Updated Jan 3, 2024 • 2.76k • 491
Intel/orca_dpo_pairs

Viewer • Updated Nov 29, 2023 • 12.9k • 1.55k • 298
argilla/distilabel-intel-orca-dpo-pairs

Viewer • Updated Feb 5, 2024 • 12.9k • 2.46k • 172
mlabonne/chatml-OpenHermes2.5-dpo-binarized-alpha

Viewer • Updated Mar 21, 2024 • 9.2k • 129 • 19
argilla/OpenHermes-2.5-dpo

Viewer • Updated Feb 22, 2024 • 998k • 56 • 5
argilla/dpo-mix-7k

Viewer • Updated Jul 16, 2024 • 7.5k • 606 • 162
argilla/distilabel-math-preference-dpo

Viewer • Updated Jul 16, 2024 • 2.42k • 303 • 82
argilla/OpenHermes2.5-dpo-binarized-alpha

Viewer • Updated Feb 10, 2024 • 9.79k • 177 • 64
databricks/databricks-dolly-15k

Viewer • Updated Jun 30, 2023 • 15k • 16.3k • 795
allenai/dolma

Updated Apr 17, 2024 • 1.8k • 880
argilla/OpenHermesPreferences

Viewer • Updated Mar 1, 2024 • 989k • 1.4k • 204
TrustLLM/TrustLLM-dataset

Preview • Updated Mar 20, 2024 • 21 • 9
HuggingFaceH4/ultrafeedback_binarized

Viewer • Updated Oct 16, 2024 • 187k • 5.47k • 275
HuggingFaceH4/ultrachat_200k

Viewer • Updated Oct 16, 2024 • 515k • 16.3k • 518
TIGER-Lab/SKGInstruct

Preview • Updated Apr 9, 2024 • 201 • 28
TIGER-Lab/SKGInstruct-skg-only

Viewer • Updated Feb 27, 2024 • 677k • 88 • 7
bigcode/the-stack-v2-train-full-ids

Viewer • Updated Jun 6, 2024 • 60.5M • 3.84k • 44
garage-bAInd/Open-Platypus

Viewer • Updated Jan 24, 2024 • 24.9k • 3.72k • 382
Training-Free Long-Context Scaling of Large Language Models

Paper • 2402.17463 • Published Feb 27, 2024 • 23
allenai/paloma

Viewer • Updated Jun 6, 2024 • 309k • 981 • 39
Cohere/BinaryVectorDB

Updated Mar 26, 2024 • 37 • 7
gretelai/synthetic_text_to_sql

Viewer • Updated May 10, 2024 • 106k • 4.73k • 497
mlabonne/chatml_dpo_pairs

Viewer • Updated Apr 11, 2024 • 12.9k • 92 • 53
argilla/distilabel-capybara-dpo-7k-binarized

Viewer • Updated Jul 16, 2024 • 7.56k • 2.62k • 181
mlabonne/orpo-dpo-mix-40k

Viewer • Updated Oct 17, 2024 • 44.2k • 801 • 278
unalignment/toxic-dpo-v0.2

Viewer • Updated Jan 9, 2024 • 541 • 80 • 123
efederici/alpaca-vs-alpaca-orpo-dpo

Viewer • Updated May 15, 2024 • 49.2k • 162 • 7
HuggingFaceFW/fineweb

Viewer • Updated Jan 31 • 25B • 317k • 2.02k
Anthropic/persuasion

Viewer • Updated Apr 9, 2024 • 3.94k • 566 • 184
allenai/WildChat-1M

Viewer • Updated Oct 17, 2024 • 838k • 2.38k • 321
allenai/WildChat

Viewer • Updated Oct 17, 2024 • 529k • 1.56k • 136
bigcode/self-oss-instruct-sc2-exec-filter-50k

Viewer • Updated Nov 4, 2024 • 50.7k • 578 • 99
HuggingFaceFW/fineweb-edu

Viewer • Updated Jan 31 • 3.3B • 499k • 648
HuggingFaceFW/fineweb-edu-score-2

Viewer • Updated Jan 31 • 13.1B • 160k • 72
NousResearch/CharacterCodex

Viewer • Updated Jun 17, 2024 • 15.9k • 410 • 219
bigcode/bigcodebench

Viewer • Updated 14 days ago • 5.7k • 11.8k • 52
dreamproit/bill_summary_us

Viewer • Updated Oct 17, 2023 • 125k • 280 • 13
HuggingFaceM4/Docmatix

Viewer • Updated Aug 26, 2024 • 2.55M • 17.2k • 256
AI-MO/NuminaMath-CoT

Viewer • Updated Nov 25, 2024 • 860k • 8.87k • 417
gouravsinha/finance-NER

Text Generation • Updated May 11, 2023 • 6 • 6
sujet-ai/Sujet-Finance-Instruct-177k

Viewer • Updated Apr 5, 2024 • 178k • 205 • 77
rajpurkar/squad

Viewer • Updated Mar 4, 2024 • 98.2k • 61.8k • 293
pminervini/HaluEval

Viewer • Updated Dec 7, 2023 • 64.5k • 1.69k • 13
argilla/magpie-ultra-v0.1

Viewer • Updated Nov 26, 2024 • 50k • 925 • 221
open-llm-leaderboard/requests

Updated 1 minute ago • 296k • 9
open-llm-leaderboard/results

Preview • Updated 14 minutes ago • 68.2k • 10
gabrielmbmb/distilabel-reflection-tuning

Viewer • Updated Sep 6, 2024 • 5 • 127 • 56
Configuration error

65

65

Semantic Hugging Face Hub Search

🔎

Search and find similar datasets
open-llm-leaderboard/AGI-0__Artificium-llama3.1-8B-001-details

Viewer • Updated 24 days ago • 41.7k • 24 • 1
argilla/FinePersonas-v0.1

Viewer • Updated Dec 11, 2024 • 42.1M • 7.14k • 399
proj-persona/PersonaHub

Viewer • Updated 5 days ago • 375k • 10.6k • 536
thesven/Reflective-MAGLLAMA-v0.1

Viewer • Updated Sep 18, 2024 • 10.2k • 315 • 48
google/frames-benchmark

Viewer • Updated Oct 15, 2024 • 824 • 2.13k • 188
TableFormer: Table Structure Understanding with Transformers

Paper • 2203.01017 • Published Mar 2, 2022
migtissera/Synthia-v1.5-I

Viewer • Updated Sep 30, 2024 • 20.7k • 81 • 46
cais/mmlu

Viewer • Updated Mar 8, 2024 • 231k • 164k • 408
LLM360/TxT360

Preview • Updated Nov 8, 2024 • 606k • 224
arcee-ai/EvolKit-20k

Viewer • Updated Sep 10, 2024 • 20k • 170 • 59
migtissera/Synthia-Coder-v1.5-I

Viewer • Updated Oct 14, 2024 • 23.6k • 108 • 32
mlabonne/open-perfectblend

Viewer • Updated Jan 15 • 1.42M • 394 • 47
KingNish/reasoning-base-20k

Viewer • Updated Oct 5, 2024 • 19.9k • 3.65k • 211
abhinand/MedEmbed-base-v0.1

Updated Oct 21, 2024 • 5.98k • 14
Running

62

62

Vectorsearch Hub Datasets

🔥

Add vectors to Hub datasets and do in memory vector search.
microsoft/orca-agentinstruct-1M-v1

Viewer • Updated Nov 1, 2024 • 1.05M • 9.39k • 431
HuggingFaceTB/smoltalk

Viewer • Updated 27 days ago • 2.2M • 8.45k • 314
OpenGVLab/MMPR

Preview • Updated Dec 21, 2024 • 247 • 47
MaziyarPanahi/calme-legalkit-v0.2

Viewer • Updated Oct 31, 2024 • 53k • 141 • 9
megrisdal/llms-txt

Viewer • Updated 6 days ago • 233 • 203 • 13
meta-llama/Llama-3.3-70B-Instruct-evals

Viewer • Updated Dec 6, 2024 • 41.3k • 318 • 30
HuggingFaceFW/fineweb-2

Viewer • Updated Jan 8 • 12.5B • 75.5k • 443
THUDM/LongBench

Viewer • Updated Dec 18, 2024 • 8.42k • 39.1k • 134
opendatalab/OmniDocBench

Viewer • Updated 27 days ago • 984 • 2.43k • 21
fluently-sets/reasoning-1-1k

Viewer • Updated Dec 21, 2024 • 1.15k • 138 • 22
Running

8

8

Transformers Pipeline Playground

🐇

Search, load and play with transformer pipelines
m-ric/agents_medium_benchmark_2

Viewer • Updated Dec 27, 2024 • 142 • 202 • 9
choosealicense/licenses

Updated Apr 17, 2024 • 590 • 16
mlabonne/FineTome-100k

Viewer • Updated Jul 29, 2024 • 100k • 13.5k • 172
openbmb/RLAIF-V-Dataset

Viewer • Updated 5 days ago • 74.8k • 4.36k • 162
NovaSky-AI/Sky-T1_data_17k

Viewer • Updated Jan 14 • 16.4k • 1.33k • 178
openai/gsm8k

Viewer • Updated Jan 4, 2024 • 17.6k • 361k • 625
generaleoley/manim-codegen

Viewer • Updated Feb 18, 2024 • 1.62k • 95 • 4
allenai/tulu-3-sft-mixture

Viewer • Updated Dec 2, 2024 • 939k • 4.96k • 119
TIGER-Lab/WebInstruct-CFT

Viewer • Updated Feb 2 • 654k • 974 • 43
penfever/rewild-sft

Viewer • Updated Feb 1 • 359k • 140 • 2
teleren/ui-navigation-corpus

Viewer • Updated Feb 3 • 1.03M • 414 • 15
bebop404/llama_training

Viewer • Updated Feb 3 • 1.45k • 22 • 1
wikimedia/wikipedia

Viewer • Updated Jan 9, 2024 • 61.6M • 98.7k • 758
ARTPARK-IISc/Vaani

Viewer • Updated 5 days ago • 9.72M • 2.15k • 43
open-r1/OpenR1-Math-220k

Viewer • Updated 19 days ago • 450k • 45.4k • 477
simplescaling/s1K-1.1

Viewer • Updated 10 days ago • 1k • 6.03k • 77
agents-course/certificates

Viewer • Updated 12 minutes ago • 13 • 56.4k • 32
dvilasuero/XSTest-R1

Viewer • Updated 17 days ago • 100 • 53 • 1
open-thoughts/OpenThoughts-114k

Viewer • Updated 18 days ago • 228k • 97.2k • 646
facebook/natural_reasoning

Viewer • Updated 17 days ago • 1.15M • 8.56k • 352
FreedomIntelligence/medical-o1-reasoning-SFT

Viewer • Updated 16 days ago • 50.1k • 26.6k • 397
dvilasuero/natural-science-reasoning

Viewer • Updated 7 days ago • 100 • 467 • 33

Upvote

Collection guide
Browse collections

LLM Training Datasets

Semantic Hugging Face Hub Search

Vectorsearch Hub Datasets

Transformers Pipeline Playground