Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

text-generation-inference

AutoTrain Compatible

Inference Endpoints

Misc with no match

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

109

Full-text search

Active filters: 7-bit

BigHuggyD/TheDrummer_Behemoth-123B-v2.1_exl2_7.0bpw_h8

Updated Nov 27, 2024 • 25

DrNicefellow/Qwen-QwQ-32B-Preview-7.0bpw-exl2

Updated Nov 28, 2024

Dracones/Qwen2.5-32B-Instruct_exl2_7.0bpw

Text Generation • Updated Dec 1, 2024

Dracones/Qwen2.5-Coder-32B-Instruct_exl2_7.0bpw

Text Generation • Updated Dec 1, 2024

Dracones/Athene-V2-Chat_exl2_7.0bpw

Text Generation • Updated Dec 15, 2024

Dracones/Llama-3.1-Nemotron-70B-Instruct_exl2_7.0bpw

Text Generation • Updated Dec 2, 2024 • 3

Dracones/Qwen2.5-72B-Instruct_exl2_7.0bpw

Text Generation • Updated Dec 2, 2024 • 1

Dracones/QwQ-32B-Preview_exl2_7.0bpw

Text Generation • Updated Dec 3, 2024

BigHuggyD/TheDrummer_Behemoth-123B-v1.2_exl2_7.0bpw_h8

Updated Dec 3, 2024 • 5

Dracones/Evathene-v1.3_exl2_7.0bpw

Text Generation • Updated Dec 3, 2024

SicariusSicariiStuff/Impish_Mind_8B-7.0bpw

Updated Dec 5, 2024

DrNicefellow/QwQ-32B-Preview-abliterated-7.0bpw-exl2

Updated Dec 6, 2024 • 3

Dracones/Llama-3.3-70B-Instruct_exl2_7.0bpw

Text Generation • Updated Dec 7, 2024 • 1

Dracones/L3.3-70B-Euryale-v2.3_exl2_7.0bpw

Text Generation • Updated Dec 10, 2024

Dracones/EVA-LLaMA-3.33-70B-v0.0_exl2_7.0bpw

Text Generation • Updated Dec 12, 2024 • 1

Dracones/72B-Qwen2.5-Kunou-v1_exl2_7.0bpw

Text Generation • Updated Dec 17, 2024

ReadyArt/Skyfall-39B_EXL2_7.0bpw_H8

Updated Dec 17, 2024

ReadyArt/Anubis-70B-v1_EXL2_7.0bpw_H8

Updated Dec 22, 2024

Dracones/Anubis-70B-v1_exl2_7.0bpw

Text Generation • Updated Dec 25, 2024

Dracones/QVQ-72B-Preview_exl2_7.0bpw

Image-Text-to-Text • Updated Dec 26, 2024

Dracones/Evayale-v1.0_exl2_7.0bpw

Text Generation • Updated Jan 6

SicariusSicariiStuff/Negative_LLAMA_70B-7.0bpw

SicariusSicariiStuff/Eximius_Persona_5B-7.0bpw

ReadyArt/Sto-vo-kor-12B_EXL2_7bpw_H8

Updated Jan 22 • 1

SicariusSicariiStuff/Wingless_Imp_8B-7.0bpw

PedroPareja/DeepSeek-R1-Distill-Qwen-32B-7bpw-h8-exl2

Text Generation • Updated Jan 26 • 5

ReadyArt/UnslopNemo-12B-v3_7bpw_H8

Text Generation • Updated Jan 26 • 2

SicariusSicariiStuff/Impish_QWEN_14B-1M-7.0bpw

ReadyArt/Cydonia-22B-v1_EXL2_7bpw_H8

Updated Jan 30 • 4

Dracones/L3.3-Nevoria-R1-70b_exl2_7.0bpw

Text Generation • Updated Jan 30