How to translate the llava-1.5-7b into llava-1.5-7b-hf?
#3
by
zhwang4ai
- opened
How to translate the llava-1.5-7b into llava-1.5-7b-hf checkpoints?
Hi,
You can use the conversion script for that: https://github.com/huggingface/transformers/blob/main/src/transformers/models/llava/convert_llava_weights_to_hf.py.
Thanks
zhwang4ai
changed discussion status to
closed
I used my own dataset to fine-tune LLaVA v1.5-7B with LoRA. After that, I used the script convert_llava_weights_to_hf.py to convert the model into Hugging Face format. However, the effects of my LoRA fine-tuning seem to have disappeared, even though I had already merged the LoRA weights beforehand.