gaunernst/gemma-3-1b-it-qat-autoawq
Text Generation
•
Updated
•
35
Gemma 3 QAT INT4 (from GGUF)
Convert official Gemma 3 QAT GGUF to AutoAWQ and compressed-tensors format for ease of deployment
-
-
gaunernst/gemma-3-4b-it-qat-autoawq
Image-Text-to-Text • Updated • 144 -
gaunernst/gemma-3-12b-it-qat-autoawq
Image-Text-to-Text • Updated • 131 • 2 -
gaunernst/gemma-3-27b-it-qat-autoawq
Image-Text-to-Text • Updated • 187 • 3 -
gaunernst/gemma-3-1b-it-qat-compressed-tensors
Text Generation • Updated • 5 -
gaunernst/gemma-3-4b-it-qat-compressed-tensors
Image-Text-to-Text • Updated • 200 -
gaunernst/gemma-3-12b-it-qat-compressed-tensors
Image-Text-to-Text • Updated • 13 -
gaunernst/gemma-3-27b-it-qat-compressed-tensors
Image-Text-to-Text • Updated • 187 • 2 -
google/gemma-3-1b-it-qat-q4_0-gguf
Text Generation • Updated • 2.99k • 23 -
google/gemma-3-4b-it-qat-q4_0-gguf
Image-Text-to-Text • Updated • 8.72k • 83 -
google/gemma-3-12b-it-qat-q4_0-gguf
Image-Text-to-Text • Updated • 6.13k • 76 -
google/gemma-3-27b-it-qat-q4_0-gguf
Image-Text-to-Text • Updated • 62.7k • 170