README.md

metadata

license: apache-2.0
base_model: llava-hf/llava-onevision-qwen2-7b-ov-hf
tags:
  - llava
  - llava-onevision
  - weather
  - satellite
  - morocco
  - meteorology
  - dora
  - fine-tuned

LLaVA-OneVision Weather Analysis - DoRA

Fine-tuned using DoRA technique for weather satellite imagery analysis.

Model Details

• Base Model: llava-hf/llava-onevision-qwen2-7b-ov-hf
• Technique: DoRA
• Domain: Weather satellite imagery analysis
• Dataset: Weather satellite images with meteorological metadata

Usage

from transformers import LlavaOnevisionForConditionalGeneration, AutoProcessor
import torch

# Load base model
model = LlavaOnevisionForConditionalGeneration.from_pretrained(
    "llava-hf/llava-onevision-qwen2-7b-ov-hf",
    torch_dtype=torch.bfloat16,
    device_map="auto"
)
processor = AutoProcessor.from_pretrained("llava-hf/llava-onevision-qwen2-7b-ov-hf")

# Load fine-tuned adapter
model.load_adapter("azdin/llava-onevision-weather-dora")

# Use for weather analysis...

Training Details

• Technique: DoRA
• Quantization: 4-bit NF4
• Training Data: Weather satellite imagery with metadata
• Target Modules: Attention and projection layers