error with ollama
#2
by
eramax
- opened
PS C:\Users\eramax> ollama run hf.co/stduhpf/google-gemma-3-27b-it-qat-q4_0-gguf-small
pulling manifest
pulling f0c5f1511116... 100% ▕████████████████████████████████████████████████████████▏ 15 GB
pulling e0a42594d802... 100% ▕████████████████████████████████████████████████████████▏ 358 B
pulling 54cb61c842fe... 100% ▕████████████████████████████████████████████████████████▏ 857 MB
pulling c5157d17cceb... 100% ▕████████████████████████████████████████████████████████▏ 44 B
pulling a730db1206a3... 100% ▕████████████████████████████████████████████████████████▏ 193 B
verifying sha256 digest
Error: digest mismatch, file must be downloaded again: want sha256:f0c5f151111629511e7466a8eceacbe228a35a0c4052b1a03c1b449a8ecb39e8, got sha256:778ac1054bc5635e39e0b1dd689c9936546597034fc860a708147f57950ae0c5
Can you retry now?
Yes, it worked fine, thanks
Could you please share the steps to reproduce this version from the source?
For the newer version? It was actually shockingly simple, If you want to reproduce it, just do:
llama-quantize.exe models\gemma-3-27b-it-q4_0.gguf models\gemma-3-27b-it-q4_0_s.gguf q4_0 12 --allow-requantize
(replace 12 with a number of cores that work with your computer)
stduhpf
changed discussion status to
closed