Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

8-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

27,183

Full-text search

Active filters: 8-bit

unsloth/Llama-4-Scout-17B-16E-Instruct-unsloth-bnb-8bit

Image-Text-to-Text • Updated about 19 hours ago • 1.48k • 9

MaziyarPanahi/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated Apr 23, 2024 • 1.01M • 88

MaziyarPanahi/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Jul 23, 2024 • 889k • 19

Vikhrmodels/QVikhr-2.5-1.5B-Instruct-SMPO_MLX-8bit

Text Generation • Updated Feb 3 • 252 • 2

MaziyarPanahi/QwQ-32B-GGUF

Text Generation • Updated Mar 7 • 615k • 3

unsloth/Llama-4-Scout-17B-16E-unsloth-bnb-8bit

Image-Text-to-Text • Updated 6 days ago • 806 • 2

CyberNative/CyberBase-13b

Text Generation • Updated May 16, 2024 • 92 • 28

asas-ai/jais_13B_8bit

Text Generation • Updated Oct 25, 2023 • 154 • 9

viai957/CodeLlama_34b-SQL

Text Generation • Updated May 4, 2024 • 109 • 1

Qwen/Qwen-7B-Chat-Int8

Text Generation • Updated Dec 13, 2023 • 180 • 8

Qwen/Qwen-14B-Chat-Int8

Text Generation • Updated Dec 13, 2023 • 361 • 6

Qwen/Qwen-1_8B-Chat-Int8

Text Generation • Updated Dec 13, 2023 • 94 • 5

Qwen/Qwen-72B-Chat-Int8

Text Generation • Updated Jan 4, 2024 • 67 • 17

Flurin17/whisper-large-v3-peft-swiss-german

Updated Feb 26, 2024 • 346 • 3

MaziyarPanahi/SauerkrautLM-7b-HerO-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • Updated Jan 29, 2024 • 85 • 2

MaziyarPanahi/Mixtral-8x7B-v0.1-GGUF

Text Generation • Updated Feb 4, 2024 • 129 • 1

MaziyarPanahi/rank_zephyr_7b_v1_full-GGUF

Text Ranking • Updated 11 days ago • 511 • 5

MaziyarPanahi/OPEN-SOLAR-KO-10.7B-GGUF

Text Generation • Updated Feb 4, 2024 • 67 • 1

Qwen/Qwen1.5-72B-Chat-GPTQ-Int8

Text Generation • Updated Apr 30, 2024 • 78 • 7

Qwen/Qwen1.5-7B-Chat-GPTQ-Int8

Text Generation • Updated Apr 30, 2024 • 105 • 26

Qwen/Qwen1.5-4B-Chat-GPTQ-Int8

Text Generation • Updated Apr 30, 2024 • 70 • 5

Qwen/Qwen1.5-1.8B-Chat-GPTQ-Int8

Text Generation • Updated Apr 30, 2024 • 80 • 2

Qwen/Qwen1.5-0.5B-Chat-GPTQ-Int8

Text Generation • Updated Apr 30, 2024 • 66 • 4

MaziyarPanahi/sqlcoder-7b-2-GGUF

Text Generation • Updated Feb 13, 2024 • 296 • 10

MaziyarPanahi/BioMistral-7B-GGUF

Text Generation • Updated Feb 19, 2024 • 1.1k • 51

MaziyarPanahi/gemma-2b-it-GGUF

Text Generation • Updated Feb 27, 2024 • 734 • 10

MaziyarPanahi/LongAlpaca-13B-GGUF

Text Generation • Updated Feb 26, 2024 • 224 • 3

MaziyarPanahi/Mistral-7B-Instruct-Aya-101-GGUF

Text Generation • Updated Feb 28, 2024 • 203 • 8

Lightricks/T5-XXL-8bit

Updated Feb 29, 2024 • 111 • 6

MaziyarPanahi/Saul-Instruct-v1-GGUF

Text Generation • Updated Mar 10, 2024 • 437 • 7