This is the LoRA on llava-hf/llama3-llava-next-8b-hf, simple vision version of reproduce Mol-Instruct model, under the same dataset with full size text dataset, this is a text alignment reproduce version.

initial commit