You need to agree to share your contact information to access this model

This repository is publicly accessible, but you have to accept the conditions to access its files and content.

YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

This model is fine-tuned based on the combination of the 100k Adjusted Caption & Paragraph dataset and the Adjusted Total QA dataset.

During fine-tuning, the updated modules include Vision Encoder, Project Layer, and LM LoRA 128.

Vision Encoder:

Directly updated

Project Layer:

Directly updated

LM LoRA 128:

lora_target_modules: 'attention.wqkv' 'attention.wo' 'feed_forward.w1' 'feed_forward.w2' 'feed_forward.w3'

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support