Edit Models filters

Misc

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

4-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

4,599

Full-text search

Active filters: exl2

DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters

Updated Dec 7, 2024 • 72

MikeRoz/deepseek-ai_DeepSeek-R1-Distill-Llama-70B-4.25bpw-h6-exl2

Updated 9 days ago • 157 • 4

Annuvin/DeepSeek-R1-Distill-Qwen-14B-4.5bpw-exl2

Updated 9 days ago • 48 • 2

Darkhn/Steelskull_L3.3-Exp-Nevoria-R1-70b-6.0bpw-h8-exl2

Text Generation • Updated 7 days ago • 35 • 2

christopherthompson81/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-exl2-4_25bpw

Updated 5 days ago • 19 • 2

ReadyArt/L3.3-Nevoria-R1-70b_EXL2_4.0bpw_H8

Text Generation • Updated 4 days ago • 48 • 2

ReadyArt/L3.3-Nevoria-R1-70b_EXL2_5.0bpw_H8

Text Generation • Updated 4 days ago • 34 • 2

Zoyd/mlabonne_NeuralDaredevil-8B-abliterated-8_0bpw_exl2

Text Generation • Updated May 28, 2024 • 16 • 2

kim512/Llama-3-70b-Arimas-story-RP-V1.6-3.0bpw-h6-exl2

Text Generation • Updated Jun 17, 2024 • 59 • 1

kim512/Llama-3-70b-Arimas-story-RP-V1.6-3.5bpw-h6-exl2

Text Generation • Updated Jun 17, 2024 • 58 • 1

kim512/Llama-3-70b-Arimas-story-RP-V1.6-4.0bpw-h6-exl2

Text Generation • Updated Jun 17, 2024 • 55 • 1

kim512/Llama-3-70b-Arimas-story-RP-V1.6-4.5bpw-h6-exl2

Text Generation • Updated Jun 17, 2024 • 59 • 1

kim512/Llama-3-70b-Arimas-story-RP-V1.6-8.0bpw-h8-exl2

Text Generation • Updated Jun 17, 2024 • 57 • 1

LoneStriker/Hermes-3-Llama-3.1-8B-3.0bpw-h6-exl2

Updated Aug 15, 2024 • 2 • 1

LoneStriker/Hermes-3-Llama-3.1-8B-4.0bpw-h6-exl2

Updated Aug 15, 2024 • 3 • 1

LoneStriker/Hermes-3-Llama-3.1-8B-5.0bpw-h6-exl2

Updated Aug 15, 2024 • 4 • 2

LoneStriker/Hermes-3-Llama-3.1-8B-6.0bpw-h6-exl2

Updated Aug 15, 2024 • 8 • 2

LoneStriker/Hermes-3-Llama-3.1-8B-8.0bpw-h8-exl2

Updated Aug 15, 2024 • 11 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-2.4bpw-h6-exl2

Updated Aug 15, 2024 • 8 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-3.5bpw-h6-exl2

Updated Aug 16, 2024 • 6 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-4.0bpw-h6-exl2

Updated Aug 16, 2024 • 3 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-4.65bpw-h6-exl2

Updated Aug 16, 2024 • 3 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-5.0bpw-h6-exl2

Updated Aug 16, 2024 • 3 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-6.0bpw-h6-exl2

Updated Aug 16, 2024 • 1 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-2.25bpw-h6-exl2

Updated Aug 16, 2024 • 4 • 1

Statuo/NemoMix-Unleashed-EXL2-8bpw

Text Generation • Updated Aug 23, 2024 • 155 • 4

Statuo/NemoMix-Unleashed-EXL2-4bpw

Text Generation • Updated Aug 23, 2024 • 67 • 8

MikeRoz/ArliAI_Mistral-Small-22B-ArliAI-RPMax-v1.1-6.0bpw-h6-exl2

Updated Sep 26, 2024 • 105 • 20

NeoChen1024/dolphin-2.9.3-mistral-nemo-12b-exl2-4.0bpw-h8

Updated Oct 3, 2024 • 9 • 1

jth01/Rombos-LLM-V2.5-Qwen-32b-4.5bpw-exl2

Text Generation • Updated Oct 24, 2024 • 14 • 2