Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

Misc with no match

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

125

Full-text search

Active filters: kto, trl

DatPySci/zephyr-7b-kto-iter0

Text Generation • Updated Apr 9, 2024 • 42

eperim/mistral-QLORA-KTO

Updated Mar 23, 2024 • 1

lewtun/kto-aligned-model-lora

Updated Mar 27, 2024 • 2

Weni/WeniGPT-QA-Zephyr-7B-4.0.1-KTO

Updated Mar 29, 2024 • 3

Weni/WeniGPT-Agents-Zephyr-1.0.22-KTO

Updated Apr 9, 2024 • 1

Weni/WeniGPT-Agents-Zephyr-1.0.23-KTO

Updated Apr 9, 2024

DatPySci/zephyr-7b-kto-iter0-des133

Text Generation • Updated Apr 11, 2024 • 19

superemohot/llama3-8b_cp-p1_tv-llama3-emb_ft-b8.3patch1e1_spin-kto-b8.3p3b1-nft

Text Generation • Updated May 2, 2024 • 9

superemohot/llama3-8b_cp-p1_tv-llama3-emb_spin-kto-b8.3p3b1

Text Generation • Updated May 2, 2024 • 8

mipo57/kto-aligned-model-lora

Updated May 13, 2024 • 5

NBA55/Experiment_with_trained_model_Final_KTO_for_all_3_issues-epoch-2

Updated May 12, 2024

stojchet/kto-python-6k-bad-ds

Updated Jun 16, 2024 • 6

sfulay/kto-aligned-model-lora

Updated Jun 17, 2024 • 6

stojchet/test_kto

Updated Jul 5, 2024 • 8

stojchet/big_kto1

Updated Jul 9, 2024 • 4

stojchet/lr_kto1

Updated Jul 9, 2024 • 1

stojchet/lr_kto2

Updated Jul 9, 2024 • 1

stojchet/kto1

Updated Jul 9, 2024 • 1

stojchet/w_kto1

Updated Jul 9, 2024 • 6

asmith26/kto_model

Text Generation • Updated Jul 6, 2024 • 15

stojchet/kto2

Updated Jul 9, 2024 • 5

TheEighthDay/kto-aligned-model-lora

Updated Jul 9, 2024 • 4

TheEighthDay/kto-aligned-model

Text Generation • Updated Jul 9, 2024 • 63

stojchet/kto_test

Updated Jul 10, 2024 • 3

stojchet/py_base1_kto1

Updated Jul 12, 2024 • 1

stojchet/py_base1_kto1_no_ref

Updated Jul 12, 2024

stojchet/kto5k1

Text Generation • Updated Jul 14, 2024 • 23

stojchet/kto5k2

Text Generation • Updated Jul 14, 2024 • 137

stojchet/kto5k3

Text Generation • Updated Jul 14, 2024 • 128

stojchet/kto5k4

Text Generation • Updated Jul 14, 2024 • 125