Edit Models filters

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

7,398

Full-text search

Active filters: awq

PrunaAI/yam-peleg-Hebrew-Mistral-7B-AWQ-4bit-smashed

Text Generation • 1B • Updated Jul 21, 2024 • 3

PrunaAI/ibm-granite-granite-3b-code-base-AWQ-4bit-smashed

Text Generation • 0.7B • Updated Jul 21, 2024 • 3

PrunaAI/rinna-llama-3-youko-8b-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 21, 2024 • 3

PrunaAI/ibm-granite-granite-8b-code-instruct-AWQ-4bit-smashed

Text Generation • 1B • Updated Jul 21, 2024 • 3

Weni/ZeroShot-Agents-Mistral-4.0.71-SFT-300-AWQ

Text Generation • 3B • Updated Jul 21, 2024 • 3

PrunaAI/openchat-openchat-3.5-0106-AWQ-4bit-smashed

Text Generation • 1B • Updated Jul 21, 2024 • 3

PrunaAI/FreedomIntelligence-Apollo-7B-AWQ-4bit-smashed

Text Generation • 3B • Updated Jul 21, 2024 • 15

PrunaAI/BramVanroy-GEITje-7B-ultra-AWQ-4bit-smashed

Text Generation • 1B • Updated Jul 21, 2024 • 3

PrunaAI/tensoropera-Fox-1-1.6B-AWQ-4bit-smashed

Text Generation • 1B • Updated Jul 21, 2024 • 3

PrunaAI/aixsatoshi-Llama-3-youko-8b-instruct-chatvector-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 22, 2024 • 3

PrunaAI/hiieu-Meta-Llama-3-8B-Instruct-function-calling-json-mode-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 22, 2024 • 3

PrunaAI/Qwen-Qwen1.5-0.5B-Chat-AWQ-4bit-smashed

Text Generation • 0.4B • Updated Jul 22, 2024 • 5

PrunaAI/cognitivecomputations-dolphin-2.9.2-qwen2-7b-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 22, 2024 • 3

PrunaAI/mzbac-llama-3-8B-Instruct-function-calling-v0.2-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 22, 2024 • 3

PrunaAI/scb10x-llama-3-typhoon-v1.5-8b-instruct-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 22, 2024 • 4

ildodeltaRule/Yi-6B-200K-AWQ-VLLM

Text Generation • 1B • Updated Jul 23, 2024 • 7

PrunaAI/HuggingFaceTB-SmolLM-1.7B-AWQ-4bit-smashed

Text Generation • 0.4B • Updated Jul 22, 2024 • 3

PrunaAI/namespace-Pt-Llama-3-8B-Instruct-80K-QLoRA-Merged-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 22, 2024 • 3

PrunaAI/Gryphe-Pantheon-RP-1.0-8b-Llama-3-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 22, 2024 • 3

PrunaAI/nothingiisreal-L3-8B-Celeste-v1-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 22, 2024 • 3

hiuman/vi-gemma-2b-RAG-awq-quantization

Text Generation • 1B • Updated Jul 23, 2024 • 4

GameScribes/Mistral-Nemo-AWQ

Text Generation • 3B • Updated Jul 22, 2024 • 4

GameScribes/Mistral-v0.3-AWQ

Text Generation • 1B • Updated Jul 22, 2024 • 4

casperhansen/qwen2-0.5b-instruct-awq

Text Generation • 0.3B • Updated Jul 22, 2024 • 10

PrunaAI/unsloth-llama-3-8b-Instruct-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 22, 2024 • 4

PrunaAI/LLM360-AmberChat-AWQ-4bit-smashed

Text Generation • 1B • Updated Jul 22, 2024 • 4

PrunaAI/Locutusque-llama-3-neural-chat-v2.2-8B-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 22, 2024 • 3

PrunaAI/grimjim-rogue-enchantress-32k-7B-AWQ-4bit-smashed

Text Generation • 1B • Updated Jul 22, 2024 • 3

PrunaAI/NousResearch-Nous-Hermes-2-Mistral-7B-DPO-AWQ-4bit-smashed

Text Generation • 1B • Updated Jul 23, 2024 • 3

PrunaAI/Sao10K-L3-8B-Stheno-v3.3-32K-AWQ-4bit-smashed

Text Generation • 2B • Updated Jul 23, 2024 • 3