gguf

#2
by cybertruck32489 - opened

I suppose it's going to be available when transformers V4.57 because trying to convert it (even using the pip install git+... command) results in an undefined architecture error.

Hi @cybertruck32489 ,

Apologies for the late reply, GGUFs were not part of the launch plans for VaultGemma. However the Gemma models are open to community contributions.

Thanks.

Sign up or log in to comment