I am so confused
#1
by
vmajor
- opened
Can you please change your naming scheme?
Not every 4-bit model needs to be called: gemma-3-27b-it-bnb-4bit
you have bnb, dynamic bnb, base dynamic and it is tiring/impossible to figure out which is which prior to downloading.
also your "best" model, the 4 bit dnyamic bnb (I guess) is safetensors only requiring the use of transformers. I am sorry if I am coming across as ungrateful, I am just frustrated.
...also vllm fails to run this on the CPU with a cascade of errors... never mind, at least it is easy to remove venvs and model directories...
vmajor
changed discussion status to
closed