abhishekchohan
/

gemma-3-27b-it-quantized-W4A16

Image-Text-to-Text

text-generation-inference

compressed-tensors

Model card Files Files and versions

Qat

#2

by ciprianv - opened Apr 20

Apr 20

Can you please do a w4a16 quantization starting froma the gemma 3 27b qat, should have less loss

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment