Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

8-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

27,197

Full-text search

Active filters: 8-bit

MaziyarPanahi/gemma-2b-it-GGUF

Text Generation • Updated Feb 27, 2024 • 559 • 10

MaziyarPanahi/LongAlpaca-13B-GGUF

Text Generation • Updated Feb 26, 2024 • 292 • 3

MaziyarPanahi/Mistral-7B-Instruct-Aya-101-GGUF

Text Generation • Updated Feb 28, 2024 • 198 • 8

Lightricks/T5-XXL-8bit

Updated Feb 29, 2024 • 118 • 6

MaziyarPanahi/Saul-Instruct-v1-GGUF

Text Generation • Updated Mar 10, 2024 • 525 • 7

Vision-CAIR/MiniGPT4-Video

Updated Jul 24, 2024 • 65 • 32

FriendliAI/Mistral-7B-Instruct-v0.2-fp8

Text Generation • Updated Apr 18, 2024 • 38 • 12

PrunaAI/Writer-palmyra-small-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 18 • 1

MaziyarPanahi/Mixtral-8x22B-v0.1-GGUF

Text Generation • Updated Apr 15, 2024 • 541k • 74

MaziyarPanahi/WizardLM-2-7B-GGUF

Text Generation • Updated Apr 15, 2024 • 790k • 78

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16, 2024 • 30.5k • 126

FriendliAI/c4ai-command-r-plus-fp8

Text Generation • Updated Apr 19, 2024 • 45 • 4

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated May 14, 2024 • 59.7k • 168

FriendliAI/Meta-Llama-3-70B-fp8

Text Generation • Updated Aug 1, 2024 • 68 • 5

MaziyarPanahi/Llama-3-8B-Instruct-32k-v0.1-GGUF

Text Generation • Updated Jun 28, 2024 • 828k • 57

MaziyarPanahi/Llama-3-8B-Instruct-64k-GGUF

Text Generation • Updated Apr 25, 2024 • 759k • 13

Zoyd/mlabonne_NeuralDaredevil-8B-abliterated-8_0bpw_exl2

Text Generation • Updated May 28, 2024 • 11 • 2

lllyasviel/omost-phi-3-mini-128k-8bits

Text Generation • Updated May 29, 2024 • 35 • 7

cortecs/Mistral-7B-Instruct-v0.3-GPTQ-8b

Text Generation • Updated Jun 18, 2024 • 10 • 1

Qwen/Qwen2-72B-Instruct-GPTQ-Int8

Text Generation • Updated Aug 21, 2024 • 84 • 15

Qwen/Qwen2-1.5B-Instruct-GPTQ-Int8

Text Generation • Updated Aug 21, 2024 • 128 • 4

Qwen/Qwen2-7B-Instruct-GPTQ-Int8

Text Generation • Updated Aug 21, 2024 • 182 • 17

Qwen/Qwen2-0.5B-Instruct-GPTQ-Int8

Text Generation • Updated Aug 21, 2024 • 138 • 3

MaziyarPanahi/Qwen2-7B-Instruct-GGUF

Text Generation • Updated Jun 6, 2024 • 541k • 11

amirMohammadi/Dorna-Llama3-8B-Instruct-Quantized4Bit

Text Generation • Updated Jun 17, 2024 • 24 • 11

kim512/Llama-3-70b-Arimas-story-RP-V1.6-8.0bpw-h8-exl2

Text Generation • Updated Jun 17, 2024 • 4 • 1

MaziyarPanahi/firefunction-v2-GGUF

Text Generation • Updated Jun 20, 2024 • 764k • 18

lakkeo/stable-cypher-instruct-3b

Text Generation • Updated Oct 3, 2024 • 1.08k • 26

AI-MO/NuminaMath-7B-TIR-GPTQ

Text Generation • Updated Jul 9, 2024 • 788 • 7

biomap-research/proteinglm-100b-int4

Updated 28 days ago • 241 • 8