Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

8-bit precision

AutoTrain Compatible

text-generation-inference

4-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

8,956

Full-text search

Active filters: pruna-ai

PrunaAI/djuna-Q2.5-Veltha-14B-0.5-AWQ-4bit-smashed

Updated Jan 21 • 7 • 1

PrunaAI/deepseek-ai-DeepSeek-R1-Distill-Qwen-1.5B-GGUF-smashed

Updated 29 days ago • 1.97k • 1

PrunaAI/google-gemma-2-2b-GGUF-smashed

Updated 21 days ago • 706 • 1

PrunaAI/facebook-MobileLLM-125M-HQQ-4bit-smashed

Updated Feb 26 • 10 • 1

PrunaAI/facebook-MobileLLM-125M-bnb-4bit-smashed

Updated Feb 26 • 9 • 2

PrunaAI/teknium-OpenHermes-2.5-Mistral-7B-HQQ-8bit-smashed

Updated 24 days ago • 9 • 1

PrunaAI/facebook-opt-125m-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 1

PrunaAI/bigscience-bloom-560m-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 1

PrunaAI/bigscience-bloomz-560m-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 3

PrunaAI/bigscience-bloom-1b7-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 2

PrunaAI/bigscience-bloom-1b1-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 2

PrunaAI/bigscience-bloomz-3b-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 4

PrunaAI/bigscience-bloom-560m-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 1

PrunaAI/bigscience-bloom-3b-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 2

PrunaAI/bigscience-bloom-1b7-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 2

PrunaAI/bigscience-bloomz-560m-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 3

PrunaAI/bigscience-bloomz-7b1-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 2

PrunaAI/bigscience-bloom-3b-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 2

PrunaAI/bigscience-bloom-1b1-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 2

PrunaAI/huggyllama-llama-7b-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 2

PrunaAI/NousResearch-Llama-2-7b-hf-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 2

PrunaAI/bigscience-bloomz-3b-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 2

PrunaAI/yahma-llama-7b-hf-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 3

PrunaAI/vj1148-llama-2-7b-legal-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 3

PrunaAI/huggyllama-llama-7b-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 7

PrunaAI/shan2003-llama-2-7b-legal-laws-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 4

PrunaAI/yahma-llama-7b-hf-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 3

PrunaAI/mosaicml-mpt-7b-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 3

PrunaAI/mosaicml-mpt-7b-instruct-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 3

PrunaAI/daryl149-llama-2-7b-chat-hf-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 11