Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

21,369

Full-text search

Active filters: 4-bit

TheBloke/Mixtral_11Bx2_MoE_19B-GPTQ

Text Generation • Updated Jan 5, 2024 • 38 • 5

TheBloke/Beyonder-4x7B-v2-GPTQ

Text Generation • Updated Jan 5, 2024 • 16 • 6

TheBloke/Beyonder-4x7B-v2-AWQ

Text Generation • Updated Jan 5, 2024 • 15 • 3

aari1995/germeo-7b-awq

Text Generation • Updated Apr 2, 2024 • 556 • 2

TheBloke/Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-AWQ

Text Generation • Updated Jan 5, 2024 • 15 • 1

TheBloke/Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-GPTQ

Text Generation • Updated Jan 5, 2024 • 16 • 3

TheBloke/phi-2-dpo-GPTQ

Text Generation • Updated Jan 5, 2024 • 12 • 5

TheBloke/Mistral-7B-Instruct-v0.2-code-ft-GPTQ

Text Generation • Updated Jan 5, 2024 • 24 • 5

TheBloke/Mistral-7B-Instruct-v0.2-code-ft-AWQ

Text Generation • Updated Jan 5, 2024 • 29 • 6

TheBloke/Rosa_v2_7B-AWQ

Text Generation • Updated Jan 5, 2024 • 16 • 2

TheBloke/Rosa_v2_7B-GPTQ

Text Generation • Updated Jan 5, 2024 • 12 • 2

Anarchist/llama-instruct-wizard-orca

Text Generation • Updated Jan 5, 2024 • 10

TheBloke/Open_Gpt4_8x7B-AWQ

Text Generation • Updated Jan 5, 2024 • 13 • 2

TheBloke/Open_Gpt4_8x7B-GPTQ

Text Generation • Updated Jan 6, 2024 • 13 • 9

nicesen/sen-llama

Text Generation • Updated Jan 6, 2024 • 12

Anarchist/llama-bad-roleplay

Text Generation • Updated Jan 6, 2024 • 13 • 2

AlignmentLab-AI/teensyorca

Text Generation • Updated Jan 13, 2024 • 18

TheBloke/zephyr-quiklang-3b-GPTQ

Text Generation • Updated Jan 6, 2024 • 13 • 1

TheBloke/LLaMA-Pro-8B-AWQ

Text Generation • Updated Jan 6, 2024 • 19 • 3

TheBloke/LLaMA-Pro-8B-GPTQ

Text Generation • Updated Jan 6, 2024 • 21 • 2

isaiahbjork/tinyllama-function-calling-v0.1-merge

Text Generation • Updated Jan 18, 2024 • 9

Danielbrdz/Barcenas-Mixtral-8x7b-4bit

Text Generation • Updated Jan 6, 2024 • 9

TheBloke/Pallas-0.5-frankenmerge-GPTQ

Text Generation • Updated Jan 6, 2024 • 14 • 1

TheBloke/Pallas-0.5-frankenmerge-AWQ

Text Generation • Updated Jan 6, 2024 • 16 • 1

TheBloke/bagel-8x7b-v0.2-GPTQ

Text Generation • Updated Jan 6, 2024 • 13 • 3

TheBloke/bagel-8x7b-v0.2-AWQ

Text Generation • Updated Jan 6, 2024 • 11 • 1

TheBloke/zephyr-quiklang-3b-4K-GPTQ

Text Generation • Updated Jan 6, 2024 • 17 • 2

TheBloke/Sensualize-Solar-10.7B-GPTQ

Text Generation • Updated Jan 6, 2024 • 76 • 8

TheBloke/Sensualize-Solar-10.7B-AWQ

Text Generation • Updated Jan 6, 2024 • 17 • 2

TheBloke/sonya-medium-x8-MoE-GPTQ

Text Generation • Updated Jan 7, 2024 • 16 • 3