This page contains quantized GGUF files for the model sam-paech/gemma-3-12b-it-dm-001.
Quants are made with imatrix calibration using Bartowski's public imatrix dataset.
The graph below gives a good idea on how these quants should perform. Data is grabbed from the llama.cpp page on perplexity.
- Downloads last month
- 2,284
Hardware compatibility
Log In
to view the estimation
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for Sketchfellow/sam-paech-gemma-3-12b-it-dm-001-GGUF
Base model
sam-paech/gemma-3-12b-it-dm-001