Embedding Model Datasets

sentence-transformers 's Collections

Parallel Sentences Datasets

MS MARCO Mined Triplets

updated Jul 3, 2024

A curated subset of the datasets that work out of the box with Sentence Transformers: https://huggingface.co/datasets?other=sentence-transformers

Upvote

sentence-transformers/gooaq

Viewer • Updated Apr 30, 2024 • 3.01M • 259 • 14
sentence-transformers/yahoo-answers

Viewer • Updated Apr 30, 2024 • 3.14M • 136 • 3
sentence-transformers/msmarco-msmarco-distilbert-base-tas-b

Viewer • Updated May 15, 2024 • 86.3M • 241 • 4
sentence-transformers/msmarco-msmarco-distilbert-base-v3

Viewer • Updated May 15, 2024 • 88.9M • 176 • 2
sentence-transformers/msmarco-msmarco-MiniLM-L-6-v3

Viewer • Updated May 15, 2024 • 80.6M • 128 • 1
sentence-transformers/msmarco-distilbert-margin-mse-cls-dot-v2

Viewer • Updated May 15, 2024 • 80.4M • 751 • 1
sentence-transformers/msmarco-distilbert-margin-mse-cls-dot-v1

Viewer • Updated May 15, 2024 • 80.8M • 457
sentence-transformers/msmarco-distilbert-margin-mse-mean-dot-v1

Viewer • Updated May 15, 2024 • 80.5M • 109
sentence-transformers/msmarco-mpnet-margin-mse-mean-v1

Viewer • Updated May 15, 2024 • 79.3M • 141
sentence-transformers/msmarco-co-condenser-margin-mse-cls-v1

Viewer • Updated May 15, 2024 • 78.9M • 594
sentence-transformers/msmarco-distilbert-margin-mse-mnrl-mean-v1

Viewer • Updated May 15, 2024 • 79.6M • 278
sentence-transformers/msmarco-distilbert-margin-mse-sym-mnrl-mean-v1

Viewer • Updated May 15, 2024 • 79.5M • 123 • 1
sentence-transformers/msmarco-distilbert-margin-mse-sym-mnrl-mean-v2

Viewer • Updated May 6, 2024 • 79.5M • 305
sentence-transformers/msmarco-co-condenser-margin-mse-sym-mnrl-mean-v1

Viewer • Updated May 15, 2024 • 78.6M • 653 • 5
sentence-transformers/msmarco-bm25

Viewer • Updated May 15, 2024 • 93.6M • 619 • 1
sentence-transformers/stackexchange-duplicates

Viewer • Updated Apr 30, 2024 • 806k • 113
sentence-transformers/eli5

Viewer • Updated Apr 30, 2024 • 325k • 152 • 6
sentence-transformers/squad

Viewer • Updated Apr 30, 2024 • 87.6k • 67 • 2
sentence-transformers/wikihow

Viewer • Updated Apr 30, 2024 • 129k • 144 • 1
sentence-transformers/amazon-reviews

Viewer • Updated Apr 30, 2024 • 87.9M • 111
sentence-transformers/natural-questions

Viewer • Updated Apr 30, 2024 • 100k • 320 • 4
sentence-transformers/amazon-qa

Viewer • Updated Apr 30, 2024 • 2.51M • 78
sentence-transformers/s2orc

Viewer • Updated May 6, 2024 • 132M • 1.23k • 4
sentence-transformers/quora-duplicates

Viewer • Updated May 1, 2024 • 3.45M • 547 • 1
sentence-transformers/wikianswers-duplicates

Viewer • Updated May 1, 2024 • 761M • 215 • 1
sentence-transformers/agnews

Viewer • Updated Apr 30, 2024 • 1.16M • 53 • 1
sentence-transformers/all-nli

Viewer • Updated May 15, 2024 • 2.86M • 2.52k • 28
sentence-transformers/stsb

Viewer • Updated Apr 25, 2024 • 8.63k • 2.31k • 11
sentence-transformers/npr

Viewer • Updated Apr 30, 2024 • 594k • 57 • 1
sentence-transformers/specter

Viewer • Updated Apr 30, 2024 • 1.06M • 93
sentence-transformers/simple-wiki

Viewer • Updated Apr 30, 2024 • 102k • 681 • 1
sentence-transformers/paq

Viewer • Updated May 1, 2024 • 64.4M • 218 • 1
sentence-transformers/altlex

Viewer • Updated Apr 30, 2024 • 113k • 103
sentence-transformers/ccnews

Viewer • Updated Apr 30, 2024 • 615k • 52
sentence-transformers/codesearchnet

Viewer • Updated Apr 30, 2024 • 1.38M • 81 • 2
sentence-transformers/sentence-compression

Viewer • Updated Apr 30, 2024 • 180k • 159 • 3
sentence-transformers/trivia-qa

Viewer • Updated Apr 30, 2024 • 73.3k • 52 • 5
sentence-transformers/flickr30k-captions

Viewer • Updated Apr 30, 2024 • 159k • 85
sentence-transformers/xsum

Viewer • Updated Apr 30, 2024 • 227k • 53
sentence-transformers/coco-captions

Viewer • Updated Apr 30, 2024 • 414k • 161 • 1
sentence-transformers/parallel-sentences-europarl

Viewer • Updated Jun 18, 2024 • 49.7M • 397 • 1
sentence-transformers/parallel-sentences-global-voices

Viewer • Updated Jun 18, 2024 • 2.2M • 281
sentence-transformers/parallel-sentences-muse

Viewer • Updated Jun 18, 2024 • 1.37M • 43
sentence-transformers/parallel-sentences-jw300

Viewer • Updated Jun 18, 2024 • 91.7M • 525 • 4
sentence-transformers/parallel-sentences-news-commentary

Viewer • Updated Jun 18, 2024 • 1.94M • 164 • 2
sentence-transformers/parallel-sentences-talks

Viewer • Updated Jun 18, 2024 • 19.6M • 1.25k • 9
sentence-transformers/parallel-sentences-tatoeba

Viewer • Updated Jun 18, 2024 • 8.35M • 498
sentence-transformers/parallel-sentences-wikimatrix

Viewer • Updated Jun 18, 2024 • 19.5M • 322 • 5
sentence-transformers/parallel-sentences-wikititles

Viewer • Updated Jun 18, 2024 • 14.7M • 94
sentence-transformers/parallel-sentences-opus-100

Viewer • Updated Jul 9, 2024 • 55M • 566 • 1
bclavie/msmarco-10m-triplets

Viewer • Updated May 21, 2024 • 10M • 68 • 4
intfloat/multilingual_cc_news

Viewer • Updated Apr 23, 2023 • 56.3M • 1.64k • 17
nthakur/swim-ir-monolingual

Viewer • Updated Apr 28, 2024 • 3.17M • 195 • 6
sentence-transformers/nli-for-simcse

Viewer • Updated Jun 18, 2024 • 2.47M • 67 • 2
sentence-transformers/dureader

Viewer • Updated Jun 18, 2024 • 3.36M • 78 • 1
sentence-transformers/hotpotqa

Viewer • Updated Jun 18, 2024 • 3.64M • 175
sentence-transformers/cmedqa-v2

Viewer • Updated Jun 19, 2024 • 128M • 177
sentence-transformers/coliee

Viewer • Updated Jun 19, 2024 • 10.2k • 74
sentence-transformers/law-gpt

Viewer • Updated Jun 19, 2024 • 11k • 62 • 9
sentence-transformers/lecard-v2

Viewer • Updated Jun 19, 2024 • 13k • 70
sentence-transformers/pubmedqa

Viewer • Updated Jun 19, 2024 • 35.4k • 135 • 1
sentence-transformers/miracl

Viewer • Updated Jun 20, 2024 • 8.95M • 188 • 2
sentence-transformers/mldr

Viewer • Updated Jun 19, 2024 • 912k • 174 • 3
sentence-transformers/mr-tydi

Viewer • Updated Jun 20, 2024 • 5.01M • 190
sentence-transformers/t2ranking

Viewer • Updated Jun 20, 2024 • 5.53M • 140
sentence-transformers/trivia-qa-triplet

Viewer • Updated Jun 21, 2024 • 52.9M • 225 • 5
jinaai/negation-dataset

Viewer • Updated Nov 8, 2023 • 10.5k • 129 • 21

Upvote

Collection guide
Browse collections