Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

8-bit precision

AutoTrain Compatible

text-generation-inference

4-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

8,956

Full-text search

Active filters: pruna-ai

PrunaAI/DiscoResearch-Llama3-DiscoLeo-Instruct-8B-v0.1-HQQ-4bit-smashed

Text Generation • Updated Jul 17, 2024 • 1

PrunaAI/DiscoResearch-Llama3-DiscoLeo-Instruct-8B-v0.1-AWQ-4bit-smashed

Text Generation • Updated Jul 17, 2024 • 63

PrunaAI/DiscoResearch-Llama3-DiscoLeo-Instruct-8B-v0.1-QUANTO-int4bit-smashed

Updated Jul 19, 2024

PrunaAI/DiscoResearch-Llama3-DiscoLeo-Instruct-8B-v0.1-QUANTO-int8bit-smashed

Updated Jul 19, 2024 • 1

PrunaAI/DiscoResearch-Llama3-DiscoLeo-Instruct-8B-v0.1-QUANTO-float8bit-smashed

Updated Jul 19, 2024 • 1

PrunaAI/DAMO-NLP-SG-VideoLLaMA2-7B-bnb-4bit-smashed

Text Generation • Updated Jul 17, 2024 • 2

PrunaAI/DAMO-NLP-SG-VideoLLaMA2-7B-bnb-8bit-smashed

Text Generation • Updated Jul 17, 2024 • 1

PrunaAI/DAMO-NLP-SG-VideoLLaMA2-7B-QUANTO-int2bit-smashed

Updated Jul 19, 2024 • 1

PrunaAI/DAMO-NLP-SG-VideoLLaMA2-7B-HQQ-4bit-smashed

Text Generation • Updated Jul 17, 2024 • 1

PrunaAI/DAMO-NLP-SG-VideoLLaMA2-7B-HQQ-2bit-smashed

Text Generation • Updated Jul 17, 2024 • 3

PrunaAI/DAMO-NLP-SG-VideoLLaMA2-7B-QUANTO-int8bit-smashed

Updated Jul 19, 2024 • 1

PrunaAI/DAMO-NLP-SG-VideoLLaMA2-7B-QUANTO-int4bit-smashed

Updated Jul 19, 2024 • 1

PrunaAI/DAMO-NLP-SG-VideoLLaMA2-7B-QUANTO-float8bit-smashed

Updated Jul 19, 2024

PrunaAI/saishf-Neural-SOVLish-Devil-8B-L3-bnb-4bit-smashed

Text Generation • Updated Jul 17, 2024 • 1

PrunaAI/saishf-Neural-SOVLish-Devil-8B-L3-bnb-8bit-smashed

Text Generation • Updated Jul 17, 2024 • 1

PrunaAI/saishf-Neural-SOVLish-Devil-8B-L3-HQQ-1bit-smashed

Text Generation • Updated Jul 17, 2024 • 2

PrunaAI/saishf-Neural-SOVLish-Devil-8B-L3-HQQ-2bit-smashed

Text Generation • Updated Jul 17, 2024 • 1

PrunaAI/saishf-Neural-SOVLish-Devil-8B-L3-HQQ-4bit-smashed

Text Generation • Updated Jul 17, 2024 • 1

PrunaAI/saishf-Neural-SOVLish-Devil-8B-L3-AWQ-4bit-smashed

Text Generation • Updated Jul 17, 2024 • 1

PrunaAI/saishf-Neural-SOVLish-Devil-8B-L3-QUANTO-float8bit-smashed

Updated Jul 19, 2024

PrunaAI/saishf-Neural-SOVLish-Devil-8B-L3-QUANTO-int8bit-smashed

Updated Jul 19, 2024

PrunaAI/openchat-openchat-3.6-8b-20240522-bnb-4bit-smashed

Text Generation • Updated Jul 17, 2024 • 1

PrunaAI/openchat-openchat-3.6-8b-20240522-bnb-8bit-smashed

Text Generation • Updated Jul 17, 2024 • 1

PrunaAI/openchat-openchat-3.6-8b-20240522-HQQ-1bit-smashed

Text Generation • Updated Jul 17, 2024 • 1

PrunaAI/openchat-openchat-3.6-8b-20240522-HQQ-2bit-smashed

Text Generation • Updated Jul 17, 2024 • 1

PrunaAI/openchat-openchat-3.6-8b-20240522-HQQ-4bit-smashed

Text Generation • Updated Jul 17, 2024 • 1

PrunaAI/openchat-openchat-3.6-8b-20240522-QUANTO-int4bit-smashed

Updated Jul 19, 2024 • 1

PrunaAI/openchat-openchat-3.6-8b-20240522-AWQ-4bit-smashed

Text Generation • Updated Jul 17, 2024 • 6

PrunaAI/openchat-openchat-3.6-8b-20240522-QUANTO-float8bit-smashed

Updated Jul 19, 2024

PrunaAI/openchat-openchat-3.6-8b-20240522-QUANTO-int8bit-smashed

Updated Jul 19, 2024