Edit Models filters

argilla/ultrafeedback-binarized-preferences-cleaned

Intel/orca_dpo_pairs

Open-Orca/SlimOrca-Dedup

meta-math/MetaMathQA

ise-uiuc/Magicoder-Evol-Instruct-110K

ise-uiuc/Magicoder-OSS-Instruct-75K

jondurbin/airoboros-2.2.1

teknium/openhermes

allenai/tulu-v2-sft-mixture

HuggingFaceH4/capybara

HuggingFaceH4/ultrachat_200k

alexredna/oasst2_dpo_pairs

cerebras/SlimPajama-627B

cognitivecomputations/WizardLM_evol_instruct_V2_196k_unfiltered_merged_split

hkust-nlp/deita-10k-v0

LDJnr/Pure-Dove

LDJnr/Verified-Camel

jondurbin/truthy-dpo-v0.1

migtissera/Synthia-v1.3

wenbopan/Chinese-dpo-pairs

allenai/tulu-v2-sft-mixture-olmo-4096

argilla/distilabel-capybara-dpo-7k-binarized

Anthropic/hh-rlhf

berkeley-nest/Nectar

lmsys/chatbot_arena_conversations

openai/summarize_from_feedback

openai/webgpt_comparisons

openbmb/UltraFeedback

Datasets with no match

mozilla-foundation/common_voice_11_0

mozilla-foundation/common_voice_7_0

HuggingFaceH4/ultrafeedback_binarized

teknium/OpenHermes-2.5

fka/awesome-chatgpt-prompts

microsoft/orca-math-word-problems-200k

allenai/MADLAD-400

m-a-p/CodeFeedback-Filtered-Instruction

cis-lmu/Glot500

Open-Orca/OpenOrca

cognitivecomputations/dolphin-coder

bigcode/starcoderdata

jondurbin/gutenberg-dpo-v0.1

cognitivecomputations/samantha-data

Open-Orca/SlimOrca

oscar-corpus/OSCAR-2109

garage-bAInd/Open-Platypus

kiranpantha/dataset-for-peft-cv-nepds

TIGER-Lab/MathInstruct

open-r1/OpenR1-Math-220k

AI-MO/NuminaMath-TIR

mozilla-foundation/common_voice_13_0

EleutherAI/pile

anthracite-org/kalo-opus-instruct-22k-no-refusal

legacy-datasets/wikipedia

databricks/databricks-dolly-15k

mozilla-foundation/common_voice_17_0

AI-MO/NuminaMath-CoT

m-a-p/Code-Feedback

OpenAssistant/oasst1

tiiuae/falcon-refinedweb

lmsys/lmsys-chat-1m

HuggingFaceTB/smoltalk

allenai/ultrafeedback_binarized_cleaned

togethercomputer/RedPajama-Data-1T

facebook/voxpopuli

jondurbin/airoboros-3.2

allenai/tulu-3-sft-mixture

Epiculous/Synthstruct-Gens-v1.1-Filtered-n-Cleaned

microsoft/orca-agentinstruct-1M-v1

Epiculous/SynthRP-Gens-v1.1-Filtered-n-Cleaned

Gryphe/Sonnet3.5-Charcard-Roleplay

HuggingFaceFW/fineweb

anthracite-org/nopm_claude_writing_fixed

nbeerbower/gutenberg2-dpo

cognitivecomputations/Dolphin-2.9

nothingiisreal/Reddit-Dirty-And-WritingPrompts

wikimedia/wikipedia

argilla/dpo-mix-7k

NousResearch/hermes-function-calling-v1

trl-lib/ultrafeedback_binarized

yahma/alpaca-cleaned

OpenCoder-LLM/opc-sft-stage1

Gryphe/Sonnet3.5-SlimOrcaDedupCleaned

internlm/Agent-FLAN

Locutusque/function-calling-chatml

DigitalLearningGmbH/MATH-lighteval

tatsu-lab/alpaca

Vezora/Tested-22k-Python-Alpaca

FreedomIntelligence/medical-o1-reasoning-SFT

OpenCoder-LLM/opc-sft-stage2

nvidia/HelpSteer

jondurbin/cinematika-v0.1

codeparrot/apps

HuggingFaceFW/fineweb-edu

mlabonne/orpo-dpo-mix-40k

Nopm/Opus_WritingStruct

glaiveai/glaive-function-calling-v2

flax-sentence-embeddings/stackexchange_xml

Gryphe/ChatGPT-4o-Writing-Prompts

mozilla-foundation/common_voice_8_0

nbeerbower/Purpura-DPO

embedding-data/PAQ_pairs

Muennighoff/natural-instructions

unalignment/toxic-dpo-v0.2

embedding-data/sentence-compression

embedding-data/WikiAnswers

argilla/distilabel-intel-orca-dpo-pairs

nbeerbower/gutenberg-moderne-dpo

nvidia/OpenCodeReasoning

HumanLLMs/Human-Like-DPO-Dataset

allura-org/Celeste-1.x-data-mixture

huggan/smithsonian_butterflies_subset

Models

143

Full-text search

Active filters: argilla/ultrafeedback-binarized-preferences-cleaned

mradermacher/prem-1B-i1-GGUF

Updated Feb 4 • 122

mradermacher/OLMo-1B-0724-Instruct-hf-GGUF

Updated Feb 23 • 92

mradermacher/OLMo-1B-0724-Instruct-hf-i1-GGUF

Updated Feb 23 • 173

EkkaratT/a5_DPO_model

Updated Mar 1 • 6

mradermacher/llama-3.1-tulu-2-dpo-70b-GGUF

Updated Mar 18 • 102

mradermacher/llama-3.1-tulu-2-dpo-70b-i1-GGUF

Updated Mar 20 • 117

silviasapora/gemma-7b-silvia_cpo-basic_long-5e-5-05-v120

Text Generation • Updated Mar 29 • 11

silviasapora/gemma-7b-cpo-basic_long-5e-5-05-v120

Text Generation • Updated Mar 29 • 9

silviasapora/gemma-7b-silvia_cpo-basic_long-5e-5-05-v130

Text Generation • Updated Mar 29 • 10

silviasapora/gemma-7b-cpo-basic_long-5e-5-05-v130

Text Generation • Updated Mar 29 • 10

silviasapora/gemma-7b-silvia_cpo-basic_long-5e-5-025-v130

Text Generation • Updated Mar 29 • 11

silviasapora/gemma-7b-cpo-basic_long-5e-5-025-v130

Text Generation • Updated Mar 29 • 13

mradermacher/llama-3.1-tulu-2-dpo-8b-GGUF

Updated Mar 29 • 68 • 1

mradermacher/llama-3.1-tulu-2-dpo-8b-i1-GGUF

Updated Mar 30 • 417 • 1

silviasapora/gemma-7b-silvia_cpo-basic_long-5e-5-025-v131

Text Generation • Updated Mar 30 • 15

silviasapora/gemma-7b-cpo-long-cpo-basic_long-1e-5-025-v140

Text Generation • Updated Mar 30 • 8

silviasapora/gemma-7b-cpo-long-silvia_cpo-basic_long-1e-5-025-v140

Text Generation • Updated Mar 31 • 10

silviasapora/gemma-7b-cpo-long-silvia_cpo-basic_long-1e-5-025-v141

Text Generation • Updated Mar 30 • 8

silviasapora/gemma-7b-cpo-long-silvia_cpo-basic_long-1e-5-025-v145

Text Generation • Updated Mar 31 • 11

tensorblock/MoxoffSrL_Moxoff-Phi3Mini-KTO-GGUF

Updated Apr 28 • 17

tensorblock/MoxoffSrL_Moxoff-Phi3Mini-PPO-GGUF

Updated Apr 28 • 57

tensorblock/MoxoffSrL_Moxoff-Phi3Mini-ORPO-GGUF

Updated Apr 28 • 41

tensorblock/MoxoffSrL_Moxoff-Phi3Mini-DPO-GGUF

Updated Apr 29 • 63