Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

AutoTrain Compatible

text-generation-inference

Inference Endpoints

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

5,570

Full-text search

Active filters: exl2

DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters

Updated 9 days ago • 107

GralchemOz/gemma-3-12b-it-exl2-4_25bpw-h6

Updated 29 days ago • 37 • 2

async0x42/DeepCoder-1.5B-Preview-exl2_4.65bpw

Text Generation • Updated 4 days ago • 13 • 2

async0x42/cogito-v1-preview-qwen-32B-exl2_4.65bpw

Text Generation • Updated 4 days ago • 17 • 2

cgus/DeepCoder-14B-Preview-exl2

Text Generation • Updated 3 days ago • 10 • 2

Natkituwu/Erosumika-7B-v3-7.1bpw-exl2

Text Generation • Updated Mar 26, 2024 • 20 • 1

LoneStriker/dolphin-2.9-llama3-70b-5.0bpw-h6-exl2

Text Generation • Updated Apr 25, 2024 • 18 • 3

DeusImperator/Midnight-Miqu-70B-v1.5_exl2_2.4bpw_rpcal

Text Generation • Updated May 19, 2024 • 11 • 1

Zoyd/mlabonne_NeuralDaredevil-8B-abliterated-8_0bpw_exl2

Text Generation • Updated May 28, 2024 • 12 • 2

Orion-zhen/Qwen2-72B-Instruct-2.0bpw-h-novel-exl2

Text Generation • Updated Jun 12, 2024 • 13 • 1

kim512/Llama-3-70b-Arimas-story-RP-V1.6-3.0bpw-h6-exl2

Text Generation • Updated Jun 17, 2024 • 13 • 1

kim512/Llama-3-70b-Arimas-story-RP-V1.6-3.5bpw-h6-exl2

Text Generation • Updated Jun 17, 2024 • 5 • 1

kim512/Llama-3-70b-Arimas-story-RP-V1.6-4.0bpw-h6-exl2

Text Generation • Updated Jun 17, 2024 • 6 • 1

kim512/Llama-3-70b-Arimas-story-RP-V1.6-4.5bpw-h6-exl2

Text Generation • Updated Jun 17, 2024 • 5 • 1

kim512/Llama-3-70b-Arimas-story-RP-V1.6-8.0bpw-h8-exl2

Text Generation • Updated Jun 17, 2024 • 5 • 1

grimjim/Mistral-Nemo-Instruct-2407-12B-6.4bpw-exl2

Text Generation • Updated Aug 25, 2024 • 23 • 5

LoneStriker/Hermes-3-Llama-3.1-8B-3.0bpw-h6-exl2

Updated Aug 15, 2024 • 7 • 1

LoneStriker/Hermes-3-Llama-3.1-8B-4.0bpw-h6-exl2

Updated Aug 15, 2024 • 11 • 1

LoneStriker/Hermes-3-Llama-3.1-8B-5.0bpw-h6-exl2

Updated Aug 15, 2024 • 5 • 2

LoneStriker/Hermes-3-Llama-3.1-8B-6.0bpw-h6-exl2

Updated Aug 15, 2024 • 7 • 2

LoneStriker/Hermes-3-Llama-3.1-8B-8.0bpw-h8-exl2

Updated Aug 15, 2024 • 6 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-2.4bpw-h6-exl2

Updated Aug 15, 2024 • 6 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-3.5bpw-h6-exl2

Updated Aug 16, 2024 • 7 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-4.0bpw-h6-exl2

Updated Aug 16, 2024 • 9 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-4.65bpw-h6-exl2

Updated Aug 16, 2024 • 6 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-5.0bpw-h6-exl2

Updated Aug 16, 2024 • 7 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-6.0bpw-h6-exl2

Updated Aug 16, 2024 • 10 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-2.25bpw-h6-exl2

Updated Aug 16, 2024 • 7 • 1

Statuo/NemoMix-Unleashed-EXL2-8bpw

Text Generation • Updated Aug 23, 2024 • 58 • 4

Statuo/NemoMix-Unleashed-EXL2-6bpw

Text Generation • Updated Aug 23, 2024 • 30 • 4