Edit Models filters

Misc

8-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

21,239

Full-text search

Active filters: 8-bit

neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w8a8

Text Generation • Updated Oct 23, 2024 • 4.42k • 14

neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w8a8

Text Generation • Updated Oct 10, 2024 • 9.46k • 19

LoneStriker/Hermes-3-Llama-3.1-8B-8.0bpw-h8-exl2

Updated Aug 15, 2024 • 11 • 1

Statuo/NemoMix-Unleashed-EXL2-8bpw

Text Generation • Updated Aug 23, 2024 • 155 • 4

Qwen/Qwen2-VL-2B-Instruct-GPTQ-Int8

Image-Text-to-Text • Updated Sep 21, 2024 • 5.21k • 13

MaziyarPanahi/Yi-Coder-1.5B-Chat-GGUF

Text Generation • Updated Sep 4, 2024 • 1.51M • 5

MaziyarPanahi/solar-pro-preview-instruct-GGUF

Text Generation • Updated Sep 13, 2024 • 1.51M • 24

Qwen/Qwen2-VL-72B-Instruct-GPTQ-Int8

Image-Text-to-Text • Updated Sep 24, 2024 • 5.25k • 10

Qwen/Qwen2.5-7B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 18, 2024 • 23.6k • 12

Qwen/Qwen2.5-14B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9, 2024 • 49.4k • 14

Qwen/Qwen2.5-72B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9, 2024 • 4.79k • 17

MaziyarPanahi/Qwen2.5-1.5B-Instruct-GGUF

Text Generation • Updated Sep 18, 2024 • 1.5M • 3

MaziyarPanahi/Qwen2.5-7B-Instruct-GGUF

Text Generation • Updated Sep 18, 2024 • 1.52M • 9

MaziyarPanahi/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 25, 2024 • 1.04M • 10

MaziyarPanahi/Llama-3.2-1B-Instruct-GGUF

Text Generation • Updated Sep 25, 2024 • 1.52M • 8

qeternity/Qwen2.5-72B-Instruct-W8A8

Updated Oct 1, 2024 • 7 • 2

malenia1/ternary-weight-embedding

Updated Dec 16, 2024 • 1.31k • 4

0xBreath/Meta-Llama-3.1-8B-Instruct-abliterated-q8-mlx

Text Generation • Updated Oct 25, 2024 • 77 • 1

MaziyarPanahi/Qwen2.5-7B-Instruct-abliterated-v2-GGUF

Text Generation • Updated Oct 30, 2024 • 47 • 3

MaziyarPanahi/Llama-3.2-1B-GGUF

Text Generation • Updated Nov 2, 2024 • 101 • 1

Qwen/Qwen2.5-Coder-32B-Instruct-GPTQ-Int8

Text Generation • Updated Nov 18, 2024 • 8.85k • 16

prithivMLmods/Marco-o1-GGUF

Text Generation • Updated Dec 5, 2024 • 424 • 12

DrNicefellow/Qwen-QwQ-32B-Preview-8.0bpw-h8-exl2

Updated Nov 28, 2024 • 16 • 3

tiiuae/Falcon3-7B-Instruct-1.58bit

Text Generation • Updated 17 days ago • 3.77k • 13

mlx-community/Llama-3.3-70B-Instruct-8bit

Text Generation • Updated Dec 6, 2024 • 8.5k • 10

MaziyarPanahi/Llama-3.3-70B-Instruct-GGUF

Text Generation • Updated Dec 7, 2024 • 1.01M • 10

CalamitousFelicitousness/Llama-3.3-70B-Instruct-W8A8-INT8

Updated Dec 7, 2024 • 410 • 4

prithivMLmods/QwQ-LCoT-3B-Instruct-GGUF

Text Generation • Updated Dec 13, 2024 • 967 • 12

MaziyarPanahi/patricide-12B-Unslop-Mell-v2-GGUF

Text Generation • Updated Dec 16, 2024 • 352 • 3

mlx-community/phi-4-8bit

Text Generation • Updated 17 days ago • 45.8k • 10