Edit Models filters

Apps

Docker Model Runner

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

9,067

Full-text search

Active filters: pruna-ai

PrunaAI/facebook-opt-125m-bnb-8bit-smashed

Text Generation • 0.1B • Updated Aug 2, 2024 • 2

PrunaAI/bigscience-bloom-560m-bnb-4bit-smashed

Text Generation • 0.4B • Updated Aug 2, 2024 • 2

PrunaAI/bigscience-bloomz-560m-bnb-4bit-smashed

Text Generation • 0.4B • Updated Aug 2, 2024 • 4

PrunaAI/bigscience-bloom-1b7-bnb-4bit-smashed

Text Generation • 1B • Updated Aug 2, 2024 • 2

PrunaAI/bigscience-bloom-1b1-bnb-4bit-smashed

Text Generation • 0.7B • Updated Aug 2, 2024 • 3

PrunaAI/bigscience-bloomz-3b-bnb-4bit-smashed

Text Generation • 2B • Updated Aug 2, 2024 • 3

PrunaAI/bigscience-bloom-560m-bnb-8bit-smashed

Text Generation • 0.6B • Updated Aug 2, 2024 • 3

PrunaAI/bigscience-bloom-3b-bnb-4bit-smashed

Text Generation • 2B • Updated Aug 2, 2024 • 6

PrunaAI/bigscience-bloom-1b7-bnb-8bit-smashed

Text Generation • 2B • Updated Aug 2, 2024 • 2

PrunaAI/bigscience-bloomz-560m-bnb-8bit-smashed

Text Generation • 0.6B • Updated Aug 2, 2024 • 3

PrunaAI/bigscience-bloomz-7b1-bnb-8bit-smashed

Text Generation • 7B • Updated Aug 2, 2024 • 6

PrunaAI/bigscience-bloom-3b-bnb-8bit-smashed

Text Generation • 3B • Updated Aug 2, 2024 • 3

PrunaAI/bigscience-bloom-1b1-bnb-8bit-smashed

Text Generation • 1B • Updated Aug 2, 2024 • 2

PrunaAI/huggyllama-llama-7b-bnb-4bit-smashed

Text Generation • 4B • Updated Aug 2, 2024 • 1

PrunaAI/NousResearch-Llama-2-7b-hf-bnb-4bit-smashed

Text Generation • 4B • Updated Aug 2, 2024 • 2

PrunaAI/bigscience-bloomz-3b-bnb-8bit-smashed

Text Generation • 3B • Updated Aug 2, 2024 • 2

PrunaAI/yahma-llama-7b-hf-bnb-4bit-smashed

Text Generation • 4B • Updated Aug 2, 2024 • 5

PrunaAI/vj1148-llama-2-7b-legal-bnb-4bit-smashed

Text Generation • 4B • Updated Aug 2, 2024 • 1

PrunaAI/huggyllama-llama-7b-bnb-8bit-smashed

Text Generation • 7B • Updated Aug 2, 2024 • 5

PrunaAI/shan2003-llama-2-7b-legal-laws-bnb-4bit-smashed

Text Generation • 4B • Updated Aug 2, 2024 • 6

PrunaAI/yahma-llama-7b-hf-bnb-8bit-smashed

Text Generation • 7B • Updated Aug 2, 2024 • 1

PrunaAI/mosaicml-mpt-7b-bnb-4bit-smashed

Text Generation • 4B • Updated Aug 2, 2024 • 2

PrunaAI/mosaicml-mpt-7b-instruct-bnb-4bit-smashed

Text Generation • 4B • Updated Aug 2, 2024 • 2

PrunaAI/daryl149-llama-2-7b-chat-hf-bnb-8bit-smashed

Text Generation • 7B • Updated Aug 2, 2024 • 2

PrunaAI/mosaicml-mpt-7b-chat-bnb-4bit-smashed

Text Generation • 4B • Updated Aug 2, 2024 • 2 • 1

PrunaAI/shan2003-llama-2-7b-legal-laws-bnb-8bit-smashed

Text Generation • 7B • Updated Aug 2, 2024 • 2

PrunaAI/mosaicml-mpt-7b-instruct-bnb-8bit-smashed

Text Generation • 7B • Updated Aug 2, 2024 • 2

PrunaAI/mosaicml-mpt-7b-bnb-8bit-smashed

Text Generation • 7B • Updated Aug 2, 2024 • 2

PrunaAI/mosaicml-mpt-7b-8k-bnb-4bit-smashed

Text Generation • 4B • Updated Aug 2, 2024 • 2

PrunaAI/vj1148-llama-2-7b-legal-bnb-8bit-smashed

Text Generation • 7B • Updated Aug 2, 2024 • 2