Granite Quantized Collection Quantized Granite models from IBM Research. • 12 items • Updated 1 day ago • 2
Qwen 2.5 Quantized Collection Quantized variants of Qwen 2.5 Instruct and Qwen VL models • 10 items • Updated 1 day ago • 1
Llama 3.3 70B Instruct Quantized Collection Quantized variants of Meta Llama 3.3 multilingual large language model (LLM) is an instruction tuned generative model in 70B (text in/text out). • 3 items • Updated 1 day ago • 1
Phi-4 Quantized Collection Quantized variants of Phi-4 family of small language and multi-modal models by Microsoft. • 3 items • Updated 1 day ago • 1
Mistral-Small-3.1 (2503) Instruct Quantized Collection Quantized variants of Mistral Small 3.1 (2503) Instruct. • 3 items • Updated 1 day ago • 2
Whisper Quantized Collection Collection of quantized whisper models created by OpenAI • 19 items • Updated 1 day ago • 3
Llama 4 Quantized Collection Quantized variants of the Llama 4 release by Meta. • 3 items • Updated 1 day ago • 2
Red Hat AI validated models - v1.0 Collection v1.0 Collection of third-party generative AI models validated by Red Hat AI for use across the Red Hat AI Product Portfolio. • 39 items • Updated 1 day ago • 7
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w4a16 Text Generation • Updated 11 days ago • 23.6k • 27
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8 Text Generation • Updated 11 days ago • 12.4k • 17