"save_pretrained" method warning.
#4
by
korjo
- opened
i get the next warning when loading model in text-generating-webui with latest GPTQ:
'''
Loading Model ...
The safetensors archive passed at models/TheBloke_koala-13B-GPTQ-4bit-128g/koala-13B-4bit-128g.safetensors does not contain metadata. Make sure to save your model with the save_pretrained method. Defaulting to 'pt' metadata.
'''
I will close this as it is only happening when loading the model with monkey-patch to allow LoRa support for a 4-bit models. I suspect monkey patch is to blame here.
korjo
changed discussion status to
closed
Yeah I've never seen that before so the monkey patch is very likely the cause.