Edit Models filters

Inference status

Misc

text-generation-inference

AutoTrain Compatible

Inference Endpoints

Misc with no match

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

18

Full-text search

Active filters: ExLlamaV2

FluffyKaeloky/Euryale-Inverted-L2-70B-exl2-6.0bpw

Text Generation • Updated Nov 30, 2023

Anthonyg5005/rishiraj-meow-10.7B-exl2

Text Generation • Updated May 13 • 15

Anthonyg5005/ReMM-v2.2-L2-13B-exl2

Text Generation • Updated Jun 18 • 10 • 1

alokabhishek/Mistral-7B-Instruct-v0.2-5.0-bpw-exl2

Text Generation • Updated Apr 6 • 8 • 1

alokabhishek/Llama-2-7b-chat-hf-5.0-bpw-exl2

Text Generation • Updated Apr 6 • 7 • 1

alokabhishek/Mistral-7B-Instruct-v0.2-4.0-bpw-exl2

Text Generation • Updated Apr 1 • 15 • 1

alokabhishek/Llama-2-7b-chat-hf-4.0-bpw-exl2

Text Generation • Updated Apr 26 • 9 • 1

alokabhishek/Llama-2-7b-chat-hf-8.0-bpw-exl2

Text Generation • Updated Apr 6 • 16 • 1

alokabhishek/Mistral-7B-Instruct-v0.2-8.0-bpw-exl2

Text Generation • Updated Apr 6 • 5 • 1

alokabhishek/Meta-Llama-3-8B-Instruct-4.0-bpw-exl2

Text Generation • Updated Apr 26 • 9 • 1

alokabhishek/Meta-Llama-3-8B-Instruct-5.0-bpw-exl2

Text Generation • Updated Apr 26 • 10 • 1

alokabhishek/Meta-Llama-3-8B-Instruct-8.0-bpw-exl2

Text Generation • Updated Apr 26 • 8 • 1

alokabhishek/Meta-Llama-3-8B-Instruct-6.0-bpw-exl2

Text Generation • Updated Apr 26 • 9 • 1

alokabhishek/Mistral-7B-Instruct-v0.2-6.0-bpw-exl2

Text Generation • Updated May 9 • 9 • 2

alokabhishek/Llama-2-7b-chat-hf-6.0-bpw-exl2

Text Generation • Updated May 9 • 16 • 1

Anthonyg5005/Qwen1.5-0.5B-Chat-exl2

Text Generation • Updated May 10 • 12

Anthonyg5005/Meta-Llama-Guard-2-8B-exl2

Text Generation • Updated Jul 28 • 13

Anthonyg5005/L3-8B-Niitama-v1-exl2

Text Generation • Updated Jul 28 • 8