Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

34,645

Full-text search

Active filters: 4-bit

TheBloke/Pallas-0.5-frankenmerge-AWQ

Text Generation • Updated Jan 6, 2024 • 20 • 1

TheBloke/bagel-8x7b-v0.2-GPTQ

Text Generation • Updated Jan 6, 2024 • 19 • 3

TheBloke/bagel-8x7b-v0.2-AWQ

Text Generation • Updated Jan 6, 2024 • 10 • 1

TheBloke/zephyr-quiklang-3b-4K-GPTQ

Text Generation • Updated Jan 6, 2024 • 26 • 2

TheBloke/Sensualize-Solar-10.7B-GPTQ

Text Generation • Updated Jan 6, 2024 • 22 • 8

TheBloke/Sensualize-Solar-10.7B-AWQ

Text Generation • Updated Jan 6, 2024 • 20 • 2

TheBloke/sonya-medium-x8-MoE-GPTQ

Text Generation • Updated Jan 7, 2024 • 17 • 3

danielhanchen/test2

Text Generation • Updated Jan 7, 2024 • 14

danielhanchen/test3

Text Generation • Updated Jan 7, 2024 • 9

Delosint/firsttestmodel

Updated Jan 7, 2024

TheBloke/LLaMA-Pro-8B-Instruct-GPTQ

Text Generation • Updated Jan 7, 2024 • 367 • 5

TheBloke/LLaMA-Pro-8B-Instruct-AWQ

Text Generation • Updated Jan 7, 2024 • 315 • 1

TheBloke/Noromaid-13B-v0.3-AWQ

Text Generation • Updated Jan 7, 2024 • 20 • 2

TheBloke/Noromaid-13B-v0.3-GPTQ

Text Generation • Updated Jan 7, 2024 • 18 • 9

Muhammadreza/Nucleus-1B-GPTQ

Text Generation • Updated Jan 7, 2024 • 9 • 1

KnutJaegersberg/MoMo-72B-4bit

Text Generation • Updated Jan 13, 2024 • 13

danielhanchen/test4

Text Generation • Updated Jan 7, 2024 • 10

Anarchist/myLora

Text Generation • Updated Jan 7, 2024 • 9

janphilippfranken/Mistral-7B-v0.1-awq

Text Generation • Updated Jan 8, 2024 • 11

Crystalcareai/WagoAWQ

Text Generation • Updated Jan 8, 2024 • 9

xinyuanL/awq-AOS-Mistral

Text Generation • Updated Jan 8, 2024 • 7

yentinglin/Taiwan-LLM-13B-v2.0-chat-awq

Text Generation • Updated Apr 20 • 22 • 4

isaiahbjork/tinyllama-function-calling-v0.2-merge

Text Generation • Updated Jan 18, 2024 • 14

TheBloke/Mixtral_34Bx2_MoE_60B-GPTQ

Text Generation • Updated Jan 8, 2024 • 14 • 7

TheBloke/Mixtral_34Bx2_MoE_60B-AWQ

Text Generation • Updated Jan 8, 2024 • 8 • 4

Technoculture/MT7Bi-alpha

Updated Jan 17, 2024 • 8

TheBloke/speechless-mistral-moloras-7B-AWQ

Text Generation • Updated Jan 8, 2024 • 20 • 3

TheBloke/speechless-mistral-moloras-7B-GPTQ

Text Generation • Updated Jan 8, 2024 • 21 • 1

bernaferrari/mistral01

Text Generation • Updated Jan 9, 2024 • 22

lewtun/handbook-sft-qlora-test

Updated Jan 9, 2024