Edit Models filters

Inference status

Misc

8-bit precision

AutoTrain Compatible

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

4,075

Full-text search

Active filters: 8-bit

cognitivecomputations/dolphin-2.9.2-qwen2-72b-eetq

Text Generation • Updated Jul 15 • 7 • 1

PrunaAI/ResplendentAI-Aura_Uncensored_l3_8B-bnb-8bit-smashed

Text Generation • Updated Jul 18 • 11 • 1

MaziyarPanahi/Mistral-Nemo-Instruct-2407-GGUF

Text Generation • Updated Jul 22 • 642 • 28

bigstorm/Llama-3-Groq-70B-Tool-Use-8.0bpw-8hb-exl2

Text Generation • Updated Jul 18 • 4 • 1

meta-llama/Llama-Guard-3-8B-INT8

Text Generation • Updated Aug 7 • 33.6k • 28

jiangchengchengNLP/huatuo-7b-sns8bits

Updated Aug 5 • 7 • 1

marcinbrzezanski/gemma-2-2b-it-gptq-8bit

Text Generation • Updated Aug 2 • 84 • 1

iqbalamo93/Meta-Llama-3.1-8B-Instruct-GPTQ-Q_8

Text Generation • Updated 8 days ago • 1.01k • 3

radlab/pLLama3-8B-chat

Text Generation • Updated 22 days ago • 27 • 1

MaziyarPanahi/calme-2.3-legalkit-8b-GGUF

Text Generation • Updated Aug 7 • 726 • 8

SicariusSicariiStuff/Dusk_Rainbow-EXL2-8.0-bpw

Updated 12 days ago • 26 • 1

ktoprakucar/Llama-Guard-3-8B-Q8-GPTQ

Text Generation • Updated 19 days ago • 47 • 1

gghfez/ArliAI-RPMax-12B-v1.1-exl2-8.0bpw

Updated 21 days ago • 19 • 1

nejumi/c4ai-command-r-08-2024-GPTQ-Int8-calib-ja-1k

Updated 16 days ago • 7 • 1

abdo-Mansour/Meta-Llama-3.1-8B-Instruct-GPTQ-8bit

Text Generation • Updated 19 days ago • 80 • 1

MaziyarPanahi/Yi-Coder-1.5B-Chat-GGUF

Text Generation • Updated 18 days ago • 543 • 4

LoneStriker/Yi-Coder-9B-8.0bpw-h8-exl2

Updated 18 days ago • 12 • 1

altomek/Yi-Coder-9B-Chat-8bpw-EXL2

Text Generation • Updated 12 days ago • 43 • 1

nejumi/c4ai-command-r-plus-08-2024-GPTQ-Int8-calib-ja-1k

Updated 16 days ago • 24 • 1

ktoprakucar/Hermes-3-Llama-3.1-8B-Q8-GPTQ

Updated 17 days ago • 32 • 2

MikeRoz/mattshumer_Reflection-Llama-3.1-70B-8.0bpw-h8-exl2

Text Generation • Updated 14 days ago • 77 • 1

ArliAI/Mistral-Nemo-12B-ArliAI-RPMax-v1.1-GPTQ_Q8

Updated 3 days ago • 34 • 2

MaziyarPanahi/DeepSeek-V2.5-GGUF

Text Generation • Updated 11 days ago • 248 • 2

MaziyarPanahi/reader-lm-0.5b-GGUF

Text Generation • Updated 11 days ago • 99 • 2

MaziyarPanahi/reader-lm-1.5b-GGUF

Text Generation • Updated 11 days ago • 110 • 1

DeusImperator/Lyra4-Gutenberg-12B_exl2_8bpw_max

Text Generation • Updated 10 days ago • 14 • 1

MykytaPetrenko/Hermes-3-Llama-3.1-8B-GPTQ-8bit

Text Generation • Updated 8 days ago • 19 • 1

Qwen/Qwen2.5-0.5B-Instruct-GPTQ-Int8

Text Generation • Updated 3 days ago • 29 • 1

Qwen/Qwen2.5-1.5B-Instruct-GPTQ-Int8

Text Generation • Updated 3 days ago • 15 • 1

MaziyarPanahi/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • Updated 4 days ago • 160 • 1