Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

preference-optimization

Inference Endpoints

text-generation-inference

8-bit precision

Misc with no match

4-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

6

Full-text search

Active filters: preference-optimization

tokutsu/japanese-answer-13b-8bit

Updated 30 days ago • 7

tahamajs/llama-3.2-3b-orpo-lora64-4bit-instruct

Updated Apr 3 • 3

Likhith003/dpo-pairrm-lora-adapter

Text Generation • Updated Apr 19 • 5

Likhith003/dpo-llmjudge-lora-adapter

Text Generation • Updated Apr 19 • 6

jasperyeoh2/mistral-dpo-peft

Updated 26 days ago • 17

loganlin777/mistral-7b-dpo-adapter

Updated 23 days ago